How to create alternate boot environment using Solaris Live Upgrade on SVM mirrors when using local (non-global) zones with its own FSs and apply patches to the newly created environment (ABE)

How to create alternate boot environment using Solaris Live Upgrade on SVM mirrors when using local (non-global) zones with its own FSs and apply patches to the newly created environment (ABE) 1

Revision 4

Author 4

Purpose 4

Audience 4

Related Docs 5

Test environment setup 7

HW 7

SW 7

Preparation of primary boot environment (PBE) for Live upgrade tools usage 8

Packages related to Live Upgrade installed on current system and their upgrade 8

Patching system for Live Upgrade usage 9

Solaris 10 Live Upgrade patch bundle application 9

Here is a risk you encounter errors to be connected to local zones' separe /var FSs 10

Steps to prevent problems to start LUbundle install script when zones have separated /var 11

New creation or recreation of ABE after one has been created in the past 12

Configuration capture: 12

Auxiliary list files prepared 20

ABE creation start & progress 21

Cmds to create ABE 21

Test your new BE if you want (strongly recommended) 23

However on my test environment I ended up with new BE lost /var FS for local zones problem 26

Script for interactive addition of /var to local zones in newly created BE 26

Switching between BEs and creating OBP aliases 30

Booting of abe-rootmirror could end up with this problem. 30

Patching with Patchbundle 0508 SPARC 32

The installbundle.sh modification was needed to overcome following error message: 33

Showed patches were removed from original patch_order file 33

Mounting ABE & checking its FSs 41

Application of Recommended patch cluster to ABE 48

Preparation of list for Recommended patches to apply – dry run 48

Application of Recommended cluster to ABE 50

Activation of patched BE 52

Please check the “Test your new BE if you want (strongly recommended)” section for: 53

ABE boot after patching 53

Revision

v2.0 August 28^th 2008

Author

Arrowaver

SSE

Sun Microsystems

Purpose

You can find Solaris Live Upgrade useful technology for many reasons which are out of scope of this doc. You will find many docs describing this technology and I believe practical example can help some of you by showing it on test environment simulating real production environment too.

The steps you will need to follow are always your environment specific. Ensure system and data FSs full backup is available before configuration changes a especially applying of any patches. Steps described bellow apply to test environment listed in the section above. It is very likely it will work in general the same way, but no one can guarantee it.

Audience

This document was created as an answer to question how to patch customer's complex environment, which architecture was result of customer's specific requirements during consolidation project. Compete test environment was set up from flar archive and Solaris was installed using Flash install method to ensure maximum similarity with the real production environment.

Related Docs

Solaris Operating System - Solaris Live Upgrade How-To Guide: his How To Guide demonstrates the use of Solaris Live Upgrade, a powerful tool for managing change, risk, and system availability on Solaris systems. This guide will cover:
BigAdmin Feature Article: Restrictions for Using Solaris Live Upgrade: This article describes the correct way to use Solaris Live Upgrade to upgrade from the Solaris 8 or 9 OS to the Solaris 10 OS.
BigAdmin Submitted Tech Tip: Guidelines for Using Solaris Live Upgrade With Solaris Zones: Here are some best practices for using Solaris Live Upgrade with Solaris Zones. Live Upgrade support for systems with zones installed was added in the Solaris 10 08/07 OS (Update 4).
BigAdmin Sun Docs: How To Use Solaris Live Upgrade to Install Patches: Solaris Live Upgrade is the recommended program to add patches.
Patching Mirrored Systems with the Solaris Live Upgrade Software - Blueprints - wikis.sun.com
BigAdmin Sun Docs: How to Upgrade the Solaris 10 OS With Non-global Zones Using Solaris Live Upgrade: This article explains how to use Solaris Live Upgrade to upgrade the Solaris 10 OS with non-global zones installed.
Solaris 10 05/08 (Update 5) Patch Bundle : Patch Corner
Patch Management Best Practices : Patch Corner
BigAdmin Feature Article: Patch Management Best Practices: This document presents some basic scenarios for creating a patch management strategy for any given organization.
#206844: Solaris[TM] Live Upgrade Software: Minimum Patch Requirements: Sun Microsystems, Inc. The Network Is The Computer[tm].
Patch Corner

http://blogs.sun.com/mhuff/entry/live_upgrade_with_solaris_volume1
Live Upgrade with Solaris Volume Manager (SVM) and Zones
http://blogs.sun.com/mhuff/entry/lu_svm
Patching with Solaris Live Upgrade

Test environment setup

HW

Sun Fire 15k (domain B)
1x SB 4x US IV 1200MHz
8 GB RAM
2x IO hsPCI
3x Dual LVD SCSI + Dual NIC PCI card
3x S1 (JBOD 3x HDD)
15x 36GB HDD 3x 18GB HDD
2x physical connetion for global zone
2x physical connection for local zones

SW

OS release: Solaris 10 11/06 s10s_u3wos_10 SPARC, SunOS 5.10 Generic_125100-05 sun4u sparc SUNW,Sun-Fire-15000
Solaris OE SW install cluster = SUNWCXall
patched during installation with February 2007 patches (EIS)
3x whole-root zone with separate FSs for /, /var and data FSs

Preparation of primary boot environment (PBE) for Live upgrade tools usage

First you need to upgrade your current environment Live Upgrade packages and patch your running system to enable proper functionality of the technology. This step is the only step requiring system outage, because patches are applied to running operation system environment (OE) – current PBE. It took about 2 hours to complete pure LUbundle application so count shutdown, boot and preparation work times when planning your production OE outage. This is two step procedure:

if not running last update(release) of Solaris 10 (this time Aug 2008 last update is Solaris 10 update 5 5/08) remove your current and install Live upgrade packages from last update Solaris image, use e.g. DVD media
patch the running OS with patches required for Live Upgrade functionality

Before one of options above is selected or patching of OS with running zones I recommend to set ALL local (non-global) zones auto-boot property to false.

Example:

root@sun15k-b # zonecfg -z cozone01 info autoboot

autoboot: true

root@sun15k-b # zonecfg -z cozone01 set autoboot=false

root@sun15k-b # zonecfg -z cozone01 info autoboot

autoboot: false

root@sun15k-b #

Packages related to Live Upgrade installed on current system and their upgrade

root@sun15k-b # pkginfo | grep -i Live

system SUNWdelu German Live Upgrade

system SUNWeslu Spanish Live Upgrade

system SUNWfrlu French Live Upgrade

system SUNWitlu Italian Live Upgrade

application SUNWlur Live Upgrade (root)

application SUNWluu Live Upgrade (usr)

application SUNWluzone Live Upgrade (zones support)

system SUNWsvlu Swedish Live Upgrade

root@sun15k-b #

root@sun15k-b # pkginfo -l SUNWlur

PKGINST: SUNWlur

NAME: Live Upgrade (root)

CATEGORY: application

ARCH: sparc

VERSION: 11.10,REV=2005.01.10.00.03

BASEDIR: /

VENDOR: Sun Microsystems, Inc.

DESC: Live Upgrade (root)

PSTAMP: on10-adms-patch20070131200140

INSTDATE: May 09 2007 14:51

HOTLINE: Please contact your local service provider

STATUS: completely installed

FILES: 35 installed pathnames

10 shared pathnames

4 linked files

15 directories

9 executables

2870 blocks used (approx)

root@sun15k-b #

root@sun15k-b # pkginfo | grep -i upgrade

system SUNWasut Sun Java System Application Server, upgrade tool

JDS3 SUNWjdsrm Java Desktop System Upgrade Package Remove

root@sun15k-b #

Use pkgrm to remove all language packages and than SUNWluu and SUNWlur. The only package related to Live Upgrade left on the system should be SUNWluzone.

Mount DVD media or use JumpStart server to access latest Solaris 10 installation image

cd /net/<Jump-Start-server>/export/install

root@sun15k-b # ls

S10u5

root@sun15k-b # cd S10u5/Product/Solaris 10/Tools/Installers/

root@sun15k-b # ls

liveupgrade20 solarisn

Run liveupgrade20 installation script to install latest Solaris 10 update image Live Upgrade packages

root@sun15k-b # ./liveupgrade20 -noconsole -nodisplay

After installation in some configurations you can find new package installed with those removed before

application SUNWlucfg Live Upgrade Configuration

The SUNWlur has changed PSTAMP too.

root@sun15k-b # pkginfo -l SUNWlur

PKGINST: SUNWlur

NAME: Live Upgrade (root)

CATEGORY: application

ARCH: sparc

VERSION: 11.10,REV=2005.01.10.00.03

BASEDIR: /

VENDOR: Sun Microsystems, Inc.

DESC: Live Upgrade (root)

PSTAMP: on10-adms-patch20080613132149

INSTDATE: Aug 08 2008 21:19

HOTLINE: Please contact your local service provider

STATUS: completely installed

FILES: 38 installed pathnames

11 shared pathnames

4 linked files

15 directories

12 executables

2507 blocks used (approx)

root@sun15k-b #

Patching system for Live Upgrade usage

This can be achieved two ways. Depending on your environment and preference choose one of:

1. Follow steps described in this InfoDoc

Document Audience:	PUBLIC
Document ID:	206844
Old Document ID:	(formerly 72099)
Title:	Solaris[TM] Live Upgrade Software: Minimum Patch Requirements
Copyright Notice:	Copyright © 2008 Sun Microsystems, Inc. All Rights Reserved
Update Date:	Fri Jun 27 00:00:00 MDT 2008

Solution Type Technical Instruction

Solution 206844 : Solaris[TM] Live Upgrade Software: Minimum Patch Requirements

Use Solaris 10 Live Upgrade patch bundle, check the bundle's README for more info. This bundle is available among other patch clusters on SunSolve

Solaris 10 Live Upgrade patch bundle application

I used the second option – installation of LUbundle. Choose destination to store the bundle, which will be available in single user mode too. I chose /crashfs dedicated to store crashdump in case of system panic for this temporary usage:

/dev/md/dsk/d100 1.9G 2.0M 1.8G 1% /crashfs

Expand the bundle, e.g:

# unzip -qq 10_sparc_lubundle.zip

Reboot to single user mode mount FS (/crashfs) if needed and cd to LUbundle dir.

root@sun15k-b # cd 10 sparc lubundle

root@sun15k-b #

root@sun15k-b # ls -l

total 274

-r--r--r-- 1 root root 2579 Jul 8 20:56 Copyright

-r--r--r-- 1 root root 14684 Jul 8 20:56 LEGAL_LICENSE.TXT

-rw-r--r-- 1 root root 34403 Jul 8 20:56 README

-rwxr-xr-x 1 root root 78628 Jul 8 20:56 install_lubundle

drwxr-xr-x 3 root root 512 Jul 8 20:56 packages

-rw-r--r-- 1 root root 420 Jul 8 20:56 patch_order

drwxr-xr-x 44 root root 1024 Jul 8 20:56 patches

-rw-r--r-- 1 root root 3941 Jul 8 20:56 patchset.conf

-rw-r--r-- 1 root root 49 Jul 8 20:56 prereq_order

root@sun15k-b #

Here is a risk you encounter errors to be connected to local zones' separe /var FSs

Following error messages can be caused by /zones/<zone-name> FS not mounted in single-user mode automaticaly

root@sun15k-b # ./install_lubundle --lubundle

Setup ........

ERROR: Space checking failed : unable to mount zone 'cozone01'.

root@sun15k-b #

So mount all local zones' root FSs. It was “mount /zones/cozone01” for this case. If problem still persists use “mountall” cmd to mount all FSs from /etc/vfstab, so zones when go into “mount” state have no FSs missing by its definitions in zones' configuration.

After this you can see next error messages:

root@sun15k-b # ./install_lubundle --lubundle

Setup ...................

Solaris 10 Live Upgrade Patch Bundle for SPARC (2008.07.05)

The patch set will complete installation in this session. No intermediate

reboots are required.

Application of patches started : 2008.08.08 20:13:11

df: (/zones/cozone01/lu/a/var) not a block device, directory or mounted resource

Application of patches finished : 2008.08.08 20:13:11

Unexpected output from command 'df -k /zones/cozone01/lu/a/var'.

Please assess cause of failure and verify system integrity before proceeding.

Install log files written :

/var/sadm/install_data/s10lubundle_short_2008.08.08_20.13.11.log

/var/sadm/install_data/s10lubundle_verbose_2008.08.08_20.13.11.log

root@sun15k-b #

In this case you have to create empty directories named “/var” on zones' root FSs in “lu/a/” subdirectories relatively to zone's “zonepath” property. Better see particular cmds needed in my test case:

mkdir -p /zones/cozone01/lu/a/var

mkdir -p /zones/cozone02/lu/a/var

mkdir -p /zones/cozone03/lu/a/var

This is workaround to enable install script check. I did several test with mounted local zone's /var FS in different directories in different install script check phases, but was not successful in “palming” real zone's /var to install script for its FS space checking. Here you need to be careful of free space on zones' /var FSs as this check is not done on them but thanks this workaround on zones' root FS instead.

When you fall into those manual steps above for fixing LUbundle install script start problems, be extremely careful of partial install script runs. The run where application of patches starts but fails afterwards. It which case a patch could be applied only to global zone or same local zones but not to all of them. Next install script run will skip this patch installation completely and silently (this include kernel patches too).

You will end up with INCONSISTENT zones if this happen and it is very complicated to fix this situation. The best way is to remove all such patches (count all dependencies too) and add them again.

You can check this in patch logs if you suspect this state:

root@sun15k-b # pwd

/var/sadm/install_data

root@sun15k-b # grep -i inconsistent *

s10lubundle_verbose_2008.08.08_20.57.25.log:WARNING - Can not boot non-global zone cozone03 to apply patches!!! This zone will be in inconsistent state

s10lubundle_verbose_2008.08.08_20.57.25.log:WARNING - Can not boot non-global zone cozone02 to apply patches!!! This zone will be in inconsistent state

root@sun15k-b #

Steps to prevent problems to start LUbundle install script when zones have separated /var

have LUbundle explanded and ready on local FS
ensure you have enough free space on zones' root & /var FSs (having same or more space on /var as on zone's root FS is safe)
boot into single-user mode
mount all root FS for you local zones like “/zones/<zone-name>”
run “mountall” cmd to mount all FSs in /etc/vfstab
create empty directories “/zones/<zone-name>/lu/a/var” for all local zones

This is just LUbundle application example. You sould have some patches applied during this process. Ensure process this in single-user mode and take special care for configurations with local zones with separated /var FS – see steps above.

root@sun15k-b # ./install_lubundle --lubundle

.........................

Solaris 10 Live Upgrade Patch Bundle for SPARC (2008.07.05)

The patch set will complete installation in this session. No intermediate

reboots are required.

Application of patches started : 2008.08.08 23:10:10

Applying 120900-04 ( 1 of 42) ... skipped

Applying 121133-02 ( 2 of 42) ... skipped

Applying 119254-57 ( 3 of 42) ... skipped

Applying 119317-01 ( 4 of 42) ... skipped

Applying 121296-01 ( 5 of 42) ... skipped

Applying 127884-01 ( 6 of 42) ... skipped

Applying 128342-01 ( 7 of 42) ... skipped

Applying 119685-09 ( 8 of 42) ... skipped

Applying 124327-04 ( 9 of 42) ... skipped

Applying 118918-24 (10 of 42) ... skipped

Applying 119042-11 (11 of 42) ... skipped

Applying 119578-30 (12 of 42) ... skipped

Applying 118833-36 (13 of 42) ... skipped

Applying 137321-01 (14 of 42) ... skipped

Applying 127922-04 (15 of 42) ... skipped

Applying 128330-02 (16 of 42) ... skipped

Applying 123121-02 (17 of 42) ... skipped

Applying 121004-04 (18 of 42) ... skipped

Applying 120235-01 (19 of 42) ... skipped

Applying 121430-25 (20 of 42) ... skipped

Applying 121428-10 (21 of 42) ... success

Applying 119081-25 (22 of 42) ... skipped

Applying 124628-06 (23 of 42) ... skipped

Applying 119252-23 (24 of 42) ... skipped

Applying 120199-13 (25 of 42) ... skipped

Applying 124630-17 (26 of 42) ... skipped

Applying 119574-02 (27 of 42) ... skipped

Applying 126538-01 (28 of 42) ... skipped

Applying 120272-20 (29 of 42) ... skipped

Applying 122640-05 (30 of 42) ... skipped

Applying 126897-02 (31 of 42) ... skipped

Applying 127755-01 (32 of 42) ... skipped

Applying 125503-02 (33 of 42) ... skipped

Applying 118731-01 (34 of 42) ... skipped

Applying 124204-04 (35 of 42) ... skipped

Applying 122660-10 (36 of 42) ... skipped

Applying 125547-02 (37 of 42) ... skipped

Applying 126419-01 (38 of 42) ... skipped

Applying 120011-14 (39 of 42) ... skipped

Applying 125891-01 (40 of 42) ... skipped

Applying 126540-02 (41 of 42) ... skipped

Applying 127127-11 (42 of 42) ... skipped

Application of patches finished : 2008.08.08 23:12:06

Following patches were applied :

121428-10

Following patches were skipped :

Patches already applied

120900-04 118918-24 121004-04 119574-02 124204-04

121133-02 119042-11 120235-01 126538-01 122660-10

119254-57 119578-30 121430-25 120272-20 125547-02

119317-01 118833-36 119081-25 122640-05 126419-01

121296-01 137321-01 124628-06 126897-02 120011-14

127884-01 127922-04 119252-23 127755-01 125891-01

128342-01 128330-02 120199-13 125503-02 126540-02

119685-09 123121-02 124630-17 118731-01 127127-11

124327-04

Installation of patch set complete. PLEASE REBOOT THE SYSTEM.

Install log files written :

/var/sadm/install_data/s10lubundle_short_2008.08.08_23.10.10.log

/var/sadm/install_data/s10lubundle_verbose_2008.08.08_23.10.10.log

root@sun15k-b #

You can do reconfiguration reboot if it is safe.

New creation or recreation of ABE after one has been created in the past

In this example you see recreation of ABE so first deletion of one (the same name) already created. You can use same steps when you need to create your very first BE same way, just skip old ABE deletion.

Configuration capture:

sun15k-b console login: root

Password:

Last login: Mon Aug 18 14:54:50 on console

Aug 18 15:44:03 sun15k-b login: ROOT LOGIN /dev/console

Sun Microsystems Inc. SunOS 5.10 Generic January 2005

You have mail.

Sourcing /root/.profile-EIS.....

TERM=vt100

WARNING: This server has running non-global zones.

Before any maintenance of this server make sure that it

could not adversely affect these zones.

Current status of Solaris zones follows:

ID NAME STATUS PATH BRAND IP

0 global running / native shared

1 cozone01 running /zones/cozone01 native shared

2 cozone03 running /zones/cozone03 native shared

3 cozone02 running /zones/cozone02 native shared

root@sun15k-b #

root@sun15k-b # zonecfg -z cozone01 export

create -b

set zonepath=/zones/cozone01

set autoboot=false

set pool=pool_smp

set ip-type=shared

add fs

set dir=/var

set special=/dev/md/dsk/d104

set raw=/dev/md/rdsk/d104

set type=ufs

end

add fs

set dir=/export/home

set special=/dev/md/dsk/d107

set raw=/dev/md/rdsk/d107

set type=ufs

end

add fs

set dir=/ora02

set special=/export/ora02

set type=lofs

add options nodevices

end

add fs

set dir=/ora03

set special=/export/ora03

set type=lofs

add options nodevices

end

add fs

set dir=/ora04

set special=/export/ora04

set type=lofs

add options nodevices

end

add fs

set dir=/ora05

set special=/export/ora05

set type=lofs

add options nodevices

end

add fs

set dir=/ora06

set special=/export/ora06

set type=lofs

add options nodevices

end

add fs

set dir=/ora07

set special=/export/ora07

set type=lofs

add options nodevices

end

add fs

set dir=/ora08

set special=/export/ora08

set type=lofs

add options nodevices

end

add fs

set dir=/app

set special=/dev/md/ora_dg/dsk/d500

set raw=/dev/md/ora_dg/rdsk/d500

set type=ufs

end

add fs

set dir=/ora01

set special=/dev/md/ora_dg/dsk/d505

set raw=/dev/md/ora_dg/rdsk/d505

set type=ufs

end

add net

set address=10.18.139.28/25

set physical=ce1

end

add attr

set name=comment

set type=string

set value="SMP platform database"

end

root@sun15k-b #

root@sun15k-b # #

root@sun15k-b #

root@sun15k-b # zonecfg -z cozone02 export

create -b

set zonepath=/zones/cozone02

set autoboot=false

set pool=pool_default

set ip-type=shared

add fs

set dir=/var

set special=/dev/md/dsk/d105

set raw=/dev/md/rdsk/d105

set type=ufs

end

add fs

set dir=/export/home

set special=/dev/md/dsk/d108

set raw=/dev/md/rdsk/d108

set type=ufs

end

add fs

set dir=/ora01

set special=/dev/md/dsk/d705

set raw=/dev/md/rdsk/d705

set type=ufs

end

add fs

set dir=/ora02

set special=/dev/md/dsk/d706

set raw=/dev/md/rdsk/d706

set type=ufs

end

add fs

set dir=/ora03

set special=/dev/md/dsk/d707

set raw=/dev/md/rdsk/d707

set type=ufs

end

add fs

set dir=/ora05

set special=/dev/md/dsk/d709

set raw=/dev/md/rdsk/d709

set type=ufs

end

add net

set address=10.18.139.29/25

set physical=ce1

end

add rctl

set name=zone.cpu-shares

add value (priv=privileged,limit=100,action=none)

end

add attr

set name=comment

set type=string

set value="Web publishing authoring DB"

end

root@sun15k-b #

root@sun15k-b # zonecfg -z cozone03 export

create -b

set zonepath=/zones/cozone03

set autoboot=false

set pool=pool_default

set ip-type=shared

add fs

set dir=/var

set special=/dev/md/dsk/d106

set raw=/dev/md/rdsk/d106

set type=ufs

end

add fs

set dir=/export/home

set special=/dev/md/dsk/d109

set raw=/dev/md/rdsk/d109

set type=ufs

end

add fs

set dir=/ora01

set special=/dev/md/dsk/d605

set raw=/dev/md/rdsk/d605

set type=ufs

end

add net

set address=10.18.139.30/25

set physical=ce1

end

add rctl

set name=zone.cpu-shares

add value (priv=privileged,limit=100,action=none)

end

add attr

set name=comment

set type=string

set value="HR information system APP"

end

root@sun15k-b #

root@sun15k-b # df -hlZ

Filesystem size used avail capacity Mounted on

/dev/md/dsk/d0 16G 10G 5.4G 66% /

/devices 0K 0K 0K 0% /devices

ctfs 0K 0K 0K 0% /system/contract

proc 0K 0K 0K 0% /proc

mnttab 0K 0K 0K 0% /etc/mnttab

swap 14G 1.4M 14G 1% /etc/svc/volatile

objfs 0K 0K 0K 0% /system/object

/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1

16G 10G 5.4G 66% /platform/sun4u-us3/lib/libc_psr.so.1

/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1

16G 10G 5.4G 66% /platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /dev/fd

/dev/md/dsk/d5 7.9G 7.4G 407M 95% /var

swap 14G 240K 14G 1% /tmp

swap 14G 64K 14G 1% /var/run

/dev/md/dsk/d100 1.9G 706M 1.1G 38% /crashfs

/dev/md/dsk/d3 480M 1.0M 431M 1% /globaldevices

/dev/md/ora_dg/dsk/d0

963M 601M 304M 67% /export/ora02

/dev/md/dsk/d101 7.9G 4.8G 3.0G 62% /zones/cozone01

/dev/md/ora_dg/dsk/d1

963M 601M 304M 67% /export/ora03

/dev/md/dsk/d102 7.9G 4.8G 3.0G 62% /zones/cozone02

/dev/md/ora_dg/dsk/d3

963M 601M 304M 67% /export/ora05

/dev/md/dsk/d6 992M 1.0M 932M 1% /export/home

/dev/md/dsk/d103 7.9G 5.2G 2.6G 67% /zones/cozone03

/dev/md/ora_dg/dsk/d2

963M 601M 304M 67% /export/ora04

/dev/md/ora_dg/dsk/d5

963M 601M 304M 67% /export/ora07

/dev/md/ora_dg/dsk/d6

963M 601M 304M 67% /export/ora08

/dev/md/ora_dg/dsk/d4

963M 601M 304M 67% /export/ora06

/dev/md/ora_dg/dsk/d500

963M 601M 304M 67% /zones/cozone01/root/app

/zones/cozone01/dev 7.9G 4.8G 3.0G 62% /zones/cozone01/root/dev

/dev/md/dsk/d107 469M 1.3M 420M 1% /zones/cozone01/root/export/home

/dev/md/ora_dg/dsk/d505

963M 601M 304M 67% /zones/cozone01/root/ora01

/export/ora02 963M 601M 304M 67% /zones/cozone01/root/ora02

/export/ora03 963M 601M 304M 67% /zones/cozone01/root/ora03

/export/ora04 963M 601M 304M 67% /zones/cozone01/root/ora04

/export/ora05 963M 601M 304M 67% /zones/cozone01/root/ora05

/export/ora06 963M 601M 304M 67% /zones/cozone01/root/ora06

/export/ora07 963M 601M 304M 67% /zones/cozone01/root/ora07

/export/ora08 963M 601M 304M 67% /zones/cozone01/root/ora08

/dev/md/dsk/d104 7.9G 415M 7.4G 6% /zones/cozone01/root/var

proc 0K 0K 0K 0% /zones/cozone01/root/proc

ctfs 0K 0K 0K 0% /zones/cozone01/root/system/contract

mnttab 0K 0K 0K 0% /zones/cozone01/root/etc/mnttab

objfs 0K 0K 0K 0% /zones/cozone01/root/system/object

swap 14G 312K 14G 1% /zones/cozone01/root/etc/svc/volatile

/zones/cozone03/dev 7.9G 5.2G 2.6G 67% /zones/cozone03/root/dev

/dev/md/dsk/d109 469M 1.0M 421M 1% /zones/cozone03/root/export/home

/dev/md/dsk/d605 963M 601M 304M 67% /zones/cozone03/root/ora01

/dev/md/dsk/d106 7.9G 482M 7.3G 7% /zones/cozone03/root/var

/zones/cozone01/root/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1

7.9G 4.8G 3.0G 62% /zones/cozone01/root/platform/sun4u-us3/lib/libc_psr.so.1

/zones/cozone01/root/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1

7.9G 4.8G 3.0G 62% /zones/cozone01/root/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /zones/cozone01/root/dev/fd

swap 14G 88K 14G 1% /zones/cozone01/root/tmp

swap 14G 32K 14G 1% /zones/cozone01/root/var/run

proc 0K 0K 0K 0% /zones/cozone03/root/proc

ctfs 0K 0K 0K 0% /zones/cozone03/root/system/contract

mnttab 0K 0K 0K 0% /zones/cozone03/root/etc/mnttab

objfs 0K 0K 0K 0% /zones/cozone03/root/system/object

swap 14G 320K 14G 1% /zones/cozone03/root/etc/svc/volatile

/zones/cozone02/dev 7.9G 4.8G 3.0G 62% /zones/cozone02/root/dev

/dev/md/dsk/d108 469M 1.0M 421M 1% /zones/cozone02/root/export/home

/dev/md/dsk/d705 963M 601M 304M 67% /zones/cozone02/root/ora01

/dev/md/dsk/d706 963M 601M 304M 67% /zones/cozone02/root/ora02

/dev/md/dsk/d707 963M 601M 304M 67% /zones/cozone02/root/ora03

/dev/md/dsk/d709 963M 601M 304M 67% /zones/cozone02/root/ora05

/dev/md/dsk/d105 7.9G 327M 7.5G 5% /zones/cozone02/root/var

proc 0K 0K 0K 0% /zones/cozone02/root/proc

ctfs 0K 0K 0K 0% /zones/cozone02/root/system/contract

mnttab 0K 0K 0K 0% /zones/cozone02/root/etc/mnttab

objfs 0K 0K 0K 0% /zones/cozone02/root/system/object

swap 14G 320K 14G 1% /zones/cozone02/root/etc/svc/volatile

/zones/cozone03/root/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1

7.9G 5.2G 2.6G 67% /zones/cozone03/root/platform/sun4u-us3/lib/libc_psr.so.1

/zones/cozone03/root/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1

7.9G 5.2G 2.6G 67% /zones/cozone03/root/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /zones/cozone03/root/dev/fd

swap 14G 120K 14G 1% /zones/cozone03/root/tmp

swap 14G 32K 14G 1% /zones/cozone03/root/var/run

/zones/cozone02/root/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1

7.9G 4.8G 3.0G 62% /zones/cozone02/root/platform/sun4u-us3/lib/libc_psr.so.1

/zones/cozone02/root/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1

7.9G 4.8G 3.0G 62% /zones/cozone02/root/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /zones/cozone02/root/dev/fd

swap 14G 120K 14G 1% /zones/cozone02/root/tmp

swap 14G 32K 14G 1% /zones/cozone02/root/var/run

root@sun15k-b #

Here you would find more SVM metadev on ABE's disks than I use in next steps. This is because I used scripts to recreate same SVM configuration again on ABE's disks including all FS used in the original BE. SVM namespace for ABE is d2XYZ, where dXYZ is the name of original (current PBE) SVM metadevice.

root@sun15k-b # metastat -p

d2000 -m d2010 d2020 1

d2010 1 1 c0t3d0s0

d2020 1 1 c1t3d0s0

d2005 -m d2015 d2025 1

d2015 1 1 c0t3d0s5

d2025 1 1 c1t3d0s5

d2003 -m d2013 d2023 1

d2013 1 1 c0t3d0s3

d2023 1 1 c1t3d0s3

d2006 -m d2016 d2026 1

d2016 1 1 c0t3d0s6

d2026 1 1 c1t3d0s6

d2001 -m d2011 d2021 1

d2011 1 1 c0t3d0s1

d2021 1 1 c1t3d0s1

d2102 -m d2042 d2062 1

d2042 1 1 d2032

d2032 -p c0t4d0s0 -o 20876228 -b 16780224

d2062 1 1 d2052

d2052 -p c1t4d0s0 -o 20876228 -b 16780224

d2100 -m d2040 d2060 1

d2040 1 1 d2030

d2030 -p c0t4d0s0 -o 1 -b 4096000

d2060 1 1 d2050

d2050 -p c1t4d0s0 -o 1 -b 4096000

d2108 -m d2048 d2068 1

d2048 1 1 d2038

d2038 -p c0t5d0s0 -o 51364680 -b 1024000

d2068 1 1 d2058

d2058 -p c1t5d0s0 -o 51364680 -b 1024000

d2101 -m d2041 d2061 1

d2041 1 1 d2031

d2031 -p c0t4d0s0 -o 4096002 -b 16780224

d2061 1 1 d2051

d2051 -p c1t4d0s0 -o 4096002 -b 16780224

d2104 -m d2044 d2064 1

d2044 1 1 d2034

d2034 -p c0t5d0s0 -o 1 -b 16780224

d2064 1 1 d2054

d2054 -p c1t5d0s0 -o 1 -b 16780224

d2103 -m d2043 d2063 1

d2043 1 1 d2033

d2033 -p c0t4d0s0 -o 37656454 -b 16780224

d2063 1 1 d2053

d2053 -p c1t4d0s0 -o 37656454 -b 16780224

d2105 -m d2045 d2065 1

d2045 1 1 d2035

d2035 -p c0t5d0s0 -o 16780226 -b 16780224

d2065 1 1 d2055

d2055 -p c1t5d0s0 -o 16780226 -b 16780224

d2106 -m d2046 d2066 1

d2046 1 1 d2036

d2036 -p c0t5d0s0 -o 33560452 -b 16780224

d2066 1 1 d2056

d2056 -p c1t5d0s0 -o 33560452 -b 16780224

d2109 -m d2049 d2069 1

d2049 1 1 d2039

d2039 -p c0t5d0s0 -o 52388682 -b 1024000

d2069 1 1 d2059

d2059 -p c1t5d0s0 -o 52388682 -b 1024000

d2107 -m d2047 d2067 1

d2047 1 1 d2037

d2037 -p c0t5d0s0 -o 50340678 -b 1024000

d2067 1 1 d2057

d2057 -p c1t5d0s0 -o 50340678 -b 1024000

d109 -m d49 d69 1

d49 1 1 d39

d39 -p c0t2d0s0 -o 52388682 -b 1024000

d69 1 1 d59

d59 -p c1t2d0s0 -o 52388682 -b 1024000

d107 -m d47 d67 1

d47 1 1 d37

d37 -p c0t2d0s0 -o 50340678 -b 1024000

d67 1 1 d57

d57 -p c1t2d0s0 -o 50340678 -b 1024000

d106 -m d46 d66 1

d46 1 1 d36

d36 -p c0t2d0s0 -o 33560452 -b 16780224

d66 1 1 d56

d56 -p c1t2d0s0 -o 33560452 -b 16780224

d105 -m d45 d65 1

d45 1 1 d35

d35 -p c0t2d0s0 -o 16780226 -b 16780224

d65 1 1 d55

d55 -p c1t2d0s0 -o 16780226 -b 16780224

d1 -m d11 d21 1

d11 1 1 c0t0d0s1

d21 1 1 c1t0d0s1

d104 -m d44 d64 1

d44 1 1 d34

d34 -p c0t2d0s0 -o 1 -b 16780224

d64 1 1 d54

d54 -p c1t2d0s0 -o 1 -b 16780224

d101 -m d41 d61 1

d41 1 1 d31

d31 -p c0t1d0s0 -o 4096002 -b 16780224

d61 1 1 d51

d51 -p c1t1d0s0 -o 4096002 -b 16780224

d108 -m d48 d68 1

d48 1 1 d38

d38 -p c0t2d0s0 -o 51364680 -b 1024000

d68 1 1 d58

d58 -p c1t2d0s0 -o 51364680 -b 1024000

d100 -m d40 d60 1

d40 1 1 d30

d30 -p c0t1d0s0 -o 1 -b 4096000

d60 1 1 d50

d50 -p c1t1d0s0 -o 1 -b 4096000

d103 -m d43 d63 1

d43 1 1 d33

d33 -p c0t1d0s0 -o 37656454 -b 16780224

d63 1 1 d53

d53 -p c1t1d0s0 -o 37656454 -b 16780224

d102 -m d42 d62 1

d42 1 1 d32

d32 -p c0t1d0s0 -o 20876228 -b 16780224

d62 1 1 d52

d52 -p c1t1d0s0 -o 20876228 -b 16780224

d6 -m d16 d26 1

d16 1 1 c0t0d0s6

d26 1 1 c1t0d0s6

d3 -m d13 d23 1

d13 1 1 c0t0d0s3

d23 1 1 c1t0d0s3

d5 -m d15 d25 1

d15 1 1 c0t0d0s5

d25 1 1 c1t0d0s5

d0 -m d10 d20 1

d10 1 1 c0t0d0s0

d20 1 1 c1t0d0s0

d169 1 1 d159

d159 -p c4t5d0s0 -o 52388682 -b 1024000

d168 1 1 d158

d158 -p c4t5d0s0 -o 51364680 -b 1024000

d167 1 1 d157

d157 -p c4t5d0s0 -o 50340678 -b 1024000

d166 1 1 d156

d156 -p c4t5d0s0 -o 33560452 -b 16780224

d165 1 1 d155

d155 -p c4t5d0s0 -o 16780226 -b 16780224

d164 1 1 d154

d154 -p c4t5d0s0 -o 1 -b 16780224

d163 1 1 d153

d153 -p c4t4d0s0 -o 37656454 -b 16780224

d162 1 1 d152

d152 -p c4t4d0s0 -o 20876228 -b 16780224

d160 1 1 d150

d150 -p c4t4d0s0 -o 1 -b 4096000

d161 1 1 d151

d151 -p c4t4d0s0 -o 4096002 -b 16780224

d126 1 1 c4t3d0s6

d123 1 1 c4t3d0s3

d125 1 1 c4t3d0s5

d120 1 1 c4t3d0s0

d121 1 1 c4t3d0s1

d709 -p c4t2d0s0 -o 8388613 -b 2097152

d707 -p c4t2d0s0 -o 6291460 -b 2097152

d706 -p c4t2d0s0 -o 4194307 -b 2097152

d705 -p c4t2d0s0 -o 2097154 -b 2097152

d605 -p c4t2d0s0 -o 1 -b 2097152

root@sun15k-b #

root@sun15k-b # metastat -s ora_dg -p

ora_dg/d505 -p c4t0d0s0 -o 16777225 -b 2097152

ora_dg/d500 -p c4t0d0s0 -o 14680072 -b 2097152

ora_dg/d6 -p c4t0d0s0 -o 12582919 -b 2097152

ora_dg/d5 -p c4t0d0s0 -o 10485766 -b 2097152

ora_dg/d4 -p c4t0d0s0 -o 8388613 -b 2097152

ora_dg/d3 -p c4t0d0s0 -o 6291460 -b 2097152

ora_dg/d2 -p c4t0d0s0 -o 4194307 -b 2097152

ora_dg/d1 -p c4t0d0s0 -o 2097154 -b 2097152

ora_dg/d0 -p c4t0d0s0 -o 1 -b 2097152

root@sun15k-b #

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes yes yes no -

Sol10u3-2Bpatched yes no no yes -

root@sun15k-b #

root@sun15k-b # ludelete Sol10u3-2Bpatched

Determining the devices to be marked free.

Updating boot environment configuration database.

Updating boot environment description database on all BEs.

Updating all boot environment configuration databases.

Boot environment <Sol10u3-2Bpatched> deleted.

root@sun15k-b #

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes yes yes no -

root@sun15k-b #

root@sun15k-b # #

root@sun15k-b #

root@sun15k-b # lufslist Sol10u3-FromFlar

boot environment name: Sol10u3-FromFlar

This boot environment is currently active.

This boot environment will be active on next system boot.

Filesystem fstype device size Mounted on Mount Options

----------------------- -------- ------------ ------------------- --------------

/dev/md/dsk/d1 swap 8743362048 - -

/dev/md/dsk/d0 ufs 17434953216 / -

/dev/md/dsk/d5 ufs 8591007744 /var -

/dev/md/dsk/d6 ufs 1073875968 /export/home -

/dev/md/dsk/d3 ufs 536937984 /globaldevices -

/dev/md/dsk/d100 ufs 2095981056 /crashfs -

/dev/md/dsk/d101 ufs 8591007744 /zones/cozone01 -

/dev/md/dsk/d102 ufs 8591007744 /zones/cozone02 -

/dev/md/dsk/d103 ufs 8591007744 /zones/cozone03 -

/dev/md/ora_dg/dsk/d0 ufs 1073741824 /export/ora02 -

/dev/md/ora_dg/dsk/d1 ufs 1073741824 /export/ora03 -

/dev/md/ora_dg/dsk/d2 ufs 1073741824 /export/ora04 -

/dev/md/ora_dg/dsk/d3 ufs 1073741824 /export/ora05 -

/dev/md/ora_dg/dsk/d4 ufs 1073741824 /export/ora06 -

/dev/md/ora_dg/dsk/d5 ufs 1073741824 /export/ora07 -

/dev/md/ora_dg/dsk/d6 ufs 1073741824 /export/ora08 -

zone <cozone01> within boot environment <Sol10u3-FromFlar>

/dev/md/dsk/d104 ufs 8591007744 /var -

/dev/md/dsk/d107 ufs 523625472 /export/home -

/dev/md/ora_dg/dsk/d500 ufs 1073741824 /app -

/dev/md/ora_dg/dsk/d505 ufs 1073741824 /ora01 -

zone <cozone03> within boot environment <Sol10u3-FromFlar>

/dev/md/dsk/d106 ufs 8591007744 /var -

/dev/md/dsk/d109 ufs 523625472 /export/home -

/dev/md/dsk/d605 ufs 1073741824 /ora01 -

zone <cozone02> within boot environment <Sol10u3-FromFlar>

/dev/md/dsk/d105 ufs 8591007744 /var -

/dev/md/dsk/d108 ufs 523625472 /export/home -

/dev/md/dsk/d705 ufs 1073741824 /ora01 -

/dev/md/dsk/d706 ufs 1073741824 /ora02 -

/dev/md/dsk/d707 ufs 1073741824 /ora03 -

/dev/md/dsk/d709 ufs 1073741824 /ora05 -

root@sun15k-b #

Auxiliary list files prepared

root@sun15k-b # pwd

/root

This is my working dir with scpripts and “list files”

root@sun15k-b # cd SVMconf

root@sun15k-b #

root@sun15k-b # ls

3rdSubmirrorsToDetach.lst detach3rdSubmirrors.cmd setup_ABEmirrs_c0+1t3+4+5+d0_phaseII.cmd

addZoneVarFS.ksh lucreateExcludeFSs.lst setup_ABEsubmirrs_c0+1t3+4+5+d0_phaseI.cmd

check_patches.ksh lucreateFSs.lst setup_SOFTpars_c1t1d0+c1t2d0.cmd

create_bigfiles.ksh mountpointsForBigfiles.lst setup_SOFTpars_c4t4d0+c4t5d0.cmd

root@sun15k-b #

This list file is easiest way to define you PBE FSs to be recreated in new ABE. I've choosen just / and /var FSs as I'm going to use new ABE for patching not any application changes. You can use -m parameter of lucreate as an alternative on cmd line.

Format: mnt_point:dsk/dev:FStype

root@sun15k-b # cat lucreateFSs.lst

/:/dev/md/dsk/d2000:ufs

/var:/dev/md/dsk/d2005:ufs

/zones/cozone01:/dev/md/dsk/d2101:ufs

/zones/cozone01/root/var:/dev/md/dsk/d2104:ufs

/zones/cozone02:/dev/md/dsk/d2102:ufs

/zones/cozone02/root/var:/dev/md/dsk/d2105:ufs

/zones/cozone03:/dev/md/dsk/d2103:ufs

/zones/cozone03/root/var:/dev/md/dsk/d2106:ufs

root@sun15k-b #

The next file is quite important in complex environments. I've found FSs of other type then lofs defined in local zones as fs resource, but not specified for recreation in new ABE causing space constrains. Such FS data will be part of root “/” FS on new ABE if not excluded by -f paramater of lucreate even it is independent file-system structure used just for one whole-root local zone. This will be problem e.g. you use SAN array LUNs as data FSs in your local zones – your new ABE root FS will not probably have enough space for that big amount of data.

So take special care of real local zones' FSs which you do not specify by -M <FSs_list_file_for_recreating> or -m on lucreate cmd line and are not of type lofs.

This is example of such FS in zonecfg export output:

add fs

set dir=/ora03

set special=/dev/md/dsk/d707

set raw=/dev/md/rdsk/d707

set type=ufs

Just be careful this FS will be mounted somewhere list /zones/<zone-name>/root/<the-dir-value-in-”set dir=”> and you need to exclude exactly this path.

root@sun15k-b # cat lucreateExcludeFSs.lst

/zones/cozone01/root/export/home

/zones/cozone01/root/app

/zones/cozone01/root/ora01

/zones/cozone02/root/export/home

/zones/cozone02/root/ora01

/zones/cozone02/root/ora02

/zones/cozone02/root/ora03

/zones/cozone02/root/ora05

/zones/cozone03/root/export/home

/zones/cozone03/root/ora01

root@sun15k-b #

ABE creation start & progress

Here you can use -c option for naming of you current PBE

-C tell lucreate wich submirror to use as a source in SVM mirror configuration (choose just one)

in case of creation of you first ABE you can use:

-c would assign the name to the current BE

-M defines file with list of FSs to be created in new ABEsubmirrs (see section above)

-f defines file with list of FSs|mountpoints|dirs|files to exclude from ABE creation process (see section above)

Zones in your current PBE are running during whole process of creation of new ABE

root@sun15k-b # zoneadm list -civ

ID NAME STATUS PATH BRAND IP

0 global running / native shared

1 cozone01 running /zones/cozone01 native shared

2 cozone03 running /zones/cozone03 native shared

3 cozone02 running /zones/cozone02 native shared

root@sun15k-b #

Cmds to create ABE

This cmd will create your very first ABE and name it “Sol10u3-2Bpatched”

root@sun15k-b #lucreate -c Sol10u3-FromFlar -C /dev/dsk/c0t0d0s0 -M ./lucreateFSs.lst -n Sol10u3-2Bpatched -f ./lucreateExcludeFSs.lst

This cmd I used to recreate ABE, so no spec of current PBE is needed anymore. I deleted the old one ABE using ludelete first. The creating process of ABE is the same as for the firsttime.

root@sun15k-b # lucreate -C /dev/dsk/c0t0d0s0 -M ./lucreateFSs.lst -n Sol10u3-2Bpatched -f ./lucreateExcludeFSs.lst

Discovering physical storage devices

Discovering logical storage devices

Cross referencing storage devices with boot environment configurations

Determining types of file systems supported

Validating file system requests

Preparing logical storage devices

Preparing physical storage devices

Configuring physical storage devices

Configuring logical storage devices

Analyzing system configuration.

Comparing source boot environment <Sol10u3-FromFlar> file systems with the

file system(s) you specified for the new boot environment. Determining

which file systems should be in the new boot environment.

Updating boot environment description database on all BEs.

Searching /dev for possible boot environment filesystem devices

Updating system configuration files.

The device </dev/dsk/c0t3d0s0> is not a root device for any boot environment; cannot get BE ID.

Creating configuration for boot environment <Sol10u3-2Bpatched>.

Source boot environment is <Sol10u3-FromFlar>.

Creating boot environment <Sol10u3-2Bpatched>.

Creating file systems on boot environment <Sol10u3-2Bpatched>.

Creating <ufs> file system for </> in zone <global> on </dev/md/dsk/d2000>.

Creating <ufs> file system for </var> in zone <global> on </dev/md/dsk/d2005>.

Creating <ufs> file system for </zones/cozone02> in zone <global> on </dev/md/dsk/d2102>.

Creating <ufs> file system for </zones/cozone02/root/var> in zone <global> on </dev/md/dsk/d2105>.

Creating <ufs> file system for </zones/cozone03> in zone <global> on </dev/md/dsk/d2103>.

Creating <ufs> file system for </zones/cozone03/root/var> in zone <global> on </dev/md/dsk/d2106>.

Creating <ufs> file system for </zones/cozone01> in zone <global> on </dev/md/dsk/d2101>.

Creating <ufs> file system for </zones/cozone01/root/var> in zone <global> on </dev/md/dsk/d2104>.

Mounting file systems for boot environment <Sol10u3-2Bpatched>.

Calculating required sizes of file systems for boot environment <Sol10u3-2Bpatched>.

Populating file systems on boot environment <Sol10u3-2Bpatched>.

Checking selection integrity.

Integrity check OK.

Populating contents of mount point </>.

Populating contents of mount point </var>.

Populating contents of mount point </zones/cozone02>.

Populating contents of mount point </zones/cozone02/root/var>.

Populating contents of mount point </zones/cozone03>.

Populating contents of mount point </zones/cozone03/root/var>.

Populating contents of mount point </zones/cozone01>.

Populating contents of mount point </zones/cozone01/root/var>.

Copying.

Creating shared file system mount points.

Copying root of zone <cozone01>.

Copying root of zone <cozone03>.

Copying root of zone <cozone02>.

Creating compare databases for boot environment <Sol10u3-2Bpatched>.

Creating compare database for file system </zones/cozone01>.

Creating compare database for file system </zones/cozone03>.

Creating compare database for file system </zones/cozone02>.

Creating compare database for file system </var>.

Creating compare database for file system </>.

Updating compare databases on boot environment <Sol10u3-2Bpatched>.

Making boot environment <Sol10u3-2Bpatched> bootable.

Setting root slice to Solaris Volume Manager metadevice </dev/md/dsk/d2000>.

Population of boot environment <Sol10u3-2Bpatched> successful.

Creation of boot environment <Sol10u3-2Bpatched> successful.

root@sun15k-b #

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes yes yes no -

Sol10u3-2Bpatched yes no no yes -

root@sun15k-b #

root@sun15k-b # lufslist Sol10u3-2Bpatched

boot environment name: Sol10u3-2Bpatched

Filesystem fstype device size Mounted on Mount Options

----------------------- -------- ------------ ------------------- --------------

/dev/md/dsk/d1 swap 8743362048 - -

/dev/md/dsk/d2000 ufs 17434953216 / -

/dev/md/dsk/d2005 ufs 8591007744 /var -

/dev/md/dsk/d6 ufs 1073875968 /export/home -

/dev/md/dsk/d3 ufs 536937984 /globaldevices -

/dev/md/dsk/d100 ufs 2095981056 /crashfs -

/dev/md/dsk/d2101 ufs 8591007744 /zones/cozone01 -

/dev/md/dsk/d2104 ufs 8591007744 /zones/cozone01/root/var -

/dev/md/dsk/d2102 ufs 8591007744 /zones/cozone02 -

/dev/md/dsk/d2105 ufs 8591007744 /zones/cozone02/root/var -

/dev/md/dsk/d2103 ufs 8591007744 /zones/cozone03 -

/dev/md/dsk/d2106 ufs 8591007744 /zones/cozone03/root/var -

/dev/md/ora_dg/dsk/d0 ufs 1073741824 /export/ora02 -

/dev/md/ora_dg/dsk/d1 ufs 1073741824 /export/ora03 -

/dev/md/ora_dg/dsk/d2 ufs 1073741824 /export/ora04 -

/dev/md/ora_dg/dsk/d3 ufs 1073741824 /export/ora05 -

/dev/md/ora_dg/dsk/d4 ufs 1073741824 /export/ora06 -

/dev/md/ora_dg/dsk/d5 ufs 1073741824 /export/ora07 -

/dev/md/ora_dg/dsk/d6 ufs 1073741824 /export/ora08 -

zone <cozone01> within boot environment <Sol10u3-2Bpatched>

/dev/md/dsk/d107 ufs 523625472 /export/home -

/dev/md/ora_dg/dsk/d500 ufs 1073741824 /app -

/dev/md/ora_dg/dsk/d505 ufs 1073741824 /ora01 -

zone <cozone03> within boot environment <Sol10u3-2Bpatched>

/dev/md/dsk/d109 ufs 523625472 /export/home -

/dev/md/dsk/d605 ufs 1073741824 /ora01 -

zone <cozone02> within boot environment <Sol10u3-2Bpatched>

/dev/md/dsk/d108 ufs 523625472 /export/home -

/dev/md/dsk/d705 ufs 1073741824 /ora01 -

/dev/md/dsk/d706 ufs 1073741824 /ora02 -

/dev/md/dsk/d707 ufs 1073741824 /ora03 -

/dev/md/dsk/d709 ufs 1073741824 /ora05 -

root@sun15k-b #

Test your new BE if you want (strongly recommended)

Now you can decide whenever to activate ABE to became PBE and do test boot into it or continue with patching.

I decide to activate and test booting. State after ABE creation looks like this:

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes yes yes no -

Sol10u3-2Bpatched yes no no yes -

root@sun15k-b #

This is how to activate ABE

root@sun15k-b # luactivate Sol10u3-2Bpatched

A Live Upgrade Sync operation will be performed on startup of boot environment <Sol10u3-2Bpatched>.

**********************************************************************

The target boot environment has been activated. It will be used when you

reboot. NOTE: You MUST NOT USE the reboot, halt, or uadmin commands. You

MUST USE either the init or the shutdown command when you reboot. If you

do not use either init or shutdown, the system will not boot using the

target BE.

**********************************************************************

In case of a failure while booting to the target BE, the following process

needs to be followed to fallback to the currently working boot environment:

1. Enter the PROM monitor (ok prompt).

2. Change the boot device back to the original boot environment by typing:

setenv boot-device /pci@5c,700000/pci@1/scsi@2/disk@0,0:a

3. Boot to the original boot environment by typing:

boot

**********************************************************************

Activation of boot environment <Sol10u3-2Bpatched> successful.

root@sun15k-b #

BEs status will than look like this:

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes yes no no -

Sol10u3-2Bpatched yes no yes no -

root@sun15k-b #

In my test environment even used proper procedure (“shudown” or “init” cmds to reboot the OS) it didn't work for me. I needed to tell the system the boot disk in OBP to boot into “Sol10u3-2Bpatched” BE.

{60} ok

{60} ok devalias

net /pci@5c,70.0000/network@3,1

man-net /pci@5c,70.0000/network@3,1

rootdisk /pci@5c,700000/pci@1/scsi@2/disk@0,0:a

name aliases

{60} ok

{60} ok printenv boot-device

boot-device = rootdisk

{60} ok

{60} ok boot /pci@5c,700000/pci@1/scsi@2/disk@3,0:a

Boot device: /pci@5c,700000/pci@1/scsi@2/disk@3,0:a File and args:

Notice: Unimplemented procedure 'encode-unit' in /pci@5c,700000/pci@1/scsi@2

Loading ufs-file-system package 1.4 04 Aug 1995 13:02:54.

FCode UFS Reader 1.12 00/07/17 15:48:16.

Loading: /platform/SUNW,Sun-Fire-15000/ufsboot

Loading: /platform/sun4u/ufsboot

^MSunOS Release 5.10 Version Generic_127127-11 64-bit

Use is subject to license terms.

os-io Hostname: sun15k-b

SUNW,eri0 : 100 Mbps half duplex link up

Configuring devices.

Aug 11 09:55:20 in.mpathd[202]: No test address configured on interface ce5; disabling probe-based failure detection on it

^MAug 11 09:55:20 in.mpathd[202]: No test address configured on interface ce4; disabling probe-based failure detection on it

^MAug 11 09:55:20 in.mpathd[202]: No test address configured on interface ce1; disabling probe-based failure detection on it

^MAug 11 09:55:20 in.mpathd[202]: No test address configured on interface ce0; disabling probe-based failure detection on it

^Mchecking ufs filesystems

/dev/md/ora_dg/rdsk/d6: is logging.

/dev/md/rdsk/d3: is logging.

/dev/md/rdsk/d100: is logging.

/dev/md/rdsk/d2106: is logging.

/dev/md/rdsk/d2103: is logging.

/dev/md/ora_dg/rdsk/d5: is logging.

/dev/md/rdsk/d6: is logging.

/dev/md/ora_dg/rdsk/d4: is logging.

/dev/md/rdsk/d2105: is logging.

/dev/md/rdsk/d2102: is logging.

/dev/md/ora_dg/rdsk/d3: is logging.

/dev/md/rdsk/d2104: is logging.

/dev/md/ora_dg/rdsk/d2: is logging.

/dev/md/rdsk/d2101: is logging.

/dev/md/ora_dg/rdsk/d1: is logging.

/dev/md/ora_dg/rdsk/d0: is logging.

/dev/md/ora_dg/rdsk/d5: is logging.

/dev/md/rdsk/d6: is logging.

/dev/md/ora_dg/rdsk/d4: is logging.

/dev/md/rdsk/d2105: is logging.

/dev/md/rdsk/d2102: is logging.

/dev/md/ora_dg/rdsk/d3: is logging.

/dev/md/rdsk/d2104: is logging.

/dev/md/ora_dg/rdsk/d2: is logging.

/dev/md/rdsk/d2101: is logging.

/dev/md/ora_dg/rdsk/d1: is logging.

/dev/md/ora_dg/rdsk/d0: is logging.

sun15k-b console login: root

Status of BEs and mounted FSs are now on new BE (see d2000 SVM metadevs)

root@sun15k-b # lustatus

Boot Environment Is Active Active Can Copy

Name Complete Now On Reboot Delete Status

-------------------------- -------- ------ --------- ------ ----------

Sol10u3-FromFlar yes no no yes -

Sol10u3-2Bpatched yes yes yes no -

root@sun15k-b # df -h

Filesystem size used avail capacity Mounted on

/dev/md/dsk/d2000 16G 10G 5.4G 66% /

/devices 0K 0K 0K 0% /devices

ctfs 0K 0K 0K 0% /system/contract

proc 0K 0K 0K 0% /proc

mnttab 0K 0K 0K 0% /etc/mnttab

swap 14G 1.4M 14G 1% /etc/svc/volatile

objfs 0K 0K 0K 0% /system/object

/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1

16G 10G 5.4G 66% /platform/sun4u-us3/lib/libc_psr.so.1

/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1

16G 10G 5.4G 66% /platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /dev/fd

/dev/md/dsk/d2005 7.9G 820M 7.0G 11% /var

swap 14G 136K 14G 1% /tmp

swap 14G 40K 14G 1% /var/run

/dev/md/dsk/d3 480M 1.0M 431M 1% /globaldevices

/dev/md/dsk/d100 1.9G 706M 1.1G 38% /crashfs

/dev/md/ora_dg/dsk/d0

963M 601M 304M 67% /export/ora02

/dev/md/dsk/d6 992M 1.0M 932M 1% /export/home

/dev/md/ora_dg/dsk/d1

963M 601M 304M 67% /export/ora03

/dev/md/dsk/d2103 7.9G 5.4G 2.4G 69% /zones/cozone03

/dev/md/ora_dg/dsk/d4

963M 601M 304M 67% /export/ora06

/dev/md/dsk/d2101 7.9G 6.0G 1.8G 77% /zones/cozone01

/dev/md/ora_dg/dsk/d2

963M 601M 304M 67% /export/ora04

/dev/md/dsk/d2102 7.9G 7.1G 697M 92% /zones/cozone02

/dev/md/ora_dg/dsk/d3

963M 601M 304M 67% /export/ora05

/dev/md/ora_dg/dsk/d5

963M 601M 304M 67% /export/ora07

/dev/md/ora_dg/dsk/d6

963M 601M 304M 67% /export/ora08

/dev/md/dsk/d2106 7.9G 235M 7.6G 3% /zones/cozone03/root/var

/dev/md/dsk/d2105 7.9G 235M 7.6G 3% /zones/cozone02/root/var

/dev/md/dsk/d2104 7.9G 415M 7.4G 6% /zones/cozone01/root/var

root@sun15k-b #

Zones are ready for its boot now

root@sun15k-b #

root@sun15k-b # zoneadm list -civ

ID NAME STATUS PATH BRAND IP

0 global running / native shared

- cozone01 installed /zones/cozone01 native shared

- cozone03 installed /zones/cozone03 native shared

- cozone02 installed /zones/cozone02 native shared

root@sun15k-b #

However on my test environment I ended up with new BE lost /var FS for local zones problem

root@sun15k-b # zoneadm -z cozone01 boot

zoneadm: zone 'cozone01': These file-systems are mounted on subdirectories of /zones/cozone01/root:

zoneadm: zone 'cozone01': /zones/cozone01/root/var

zoneadm: zone 'cozone01': call to zoneadmd failed

root@sun15k-b #

In this case you should check local zones configuration if zones' resource of type “fs” for /var FS persisted BE creation. It was lost for all local zones in new BE zones' configuration. Actually this entries were not crated rather then had been lost.

Be careful, the /var FS was recreated in new BE as was requested during lucreate cmd phase, the /var FS reference was just lost from local zones' configurations. You need to specify the ABE /var when adding back (it's the d2XYZ SVM metadev). Use zonecfg cmd to manualy add “fs” resource entry for /var in all local zones or use my script showed in next section for interactive adding them for you.

Example of SVM metadev for cozone01 local zone for lost /var FS as was defined in list file for lucreate (-M parameter):

/zones/cozone01/root/var:/dev/md/dsk/d2104:ufs

The zonecfg entry looks like this:

fs:

dir: /var

special: /dev/md/dsk/d2104

raw: /dev/md/rdsk/d2104

type: ufs

options: []

Here I have /var FS fixed for zone cozone01

# zoneadm -z cozone01 boot

root@sun15k-b #

# zoneadm list -civ

ID NAME STATUS PATH BRAND IP

0 global running / native shared

19 cozone01 running /zones/cozone01 native shared

- cozone03 installed /zones/cozone03 native shared

- cozone02 installed /zones/cozone02 native shared

root@sun15k-b #

Script for interactive addition of /var to local zones in newly created BE

root@sun15k-b # cat addZoneVarFS.ksh

#!/bin/ksh

function create_cmdfile {

DEV="$1"

RDEV="$2"

CMDFILE="/tmp/$3-zonecfg4varFS.cmd"

cat > $CMDFILE << __EOF

add fs

set dir=/var

set special=`echo $DEV`

set raw=`echo $RDEV`

set type=ufs

end

__EOF

}

function check_zone4varFS {

##echo "DEBUG check_zone4varFS function"

zonecfg -z $ZONENAME export | grep '/var' 2>&1 1>/dev/null

if [ $? -ne 0 ]

then

echo " Zone $ZONENAME separate /var FS not found."

read ADDVAR?"Do you want do add /var FS to zone config (Y/N)? "

case $ADDVAR in

y|Y)

ADDVARFLAG=0

;;

n|N)

ADDVARFLAG=1

;;

echo "Please anwer Y or N."

ADDVARFLAG=2

check_zone4varFS

;;

esac

else

echo " Zone $ZONENAME has /var FS defined as separate FS resource."

}

function check_root {

id | grep 'uid=0(root)' 2>&1 > /dev/null

if [ $? -ne 0 ]

then

echo "You must be super-user to run this scprit propertly!"

echo "Exiting..."

exit 3

}

function backup_zones {

BACKUPFILENAME="zonesDirBackup`date +%y%m%d%H%M%S`.tar"

cd /var/tmp

tar cf $BACKUPFILENAME -C / etc/zones

if [ $? -ne 0 ]

then

echo " Backup of /etc/zones directory FAILED!"

else

echo " Backup of /etc/zones directore done to /var/tmp, filename: $BACKUPFILENAME."

cd - 2>&1 > /dev/null

}

# MAIN body

echo

check_root

backup_zones

echo

zoneadm list -civ | egrep -v 'global|ID.*NAME.*STATUS' | awk '{print $2}' > /tmp/zonecfg4varFS.lst

for ZONENAME in `cat /tmp/zonecfg4varFS.lst`

echo

echo "Checking zone: $ZONENAME"

echo

ADDVARFLAG=""

check_zone4varFS

case $ADDVARFLAG in

read ZONEVARDSK?"Specify device for /var mountpoint for zone $ZONENAME: "

read ZONEVARRDSK?"Specify raw device for /var mountpoint for zone $ZONENAME: "

create_cmdfile $ZONEVARDSK $ZONEVARRDSK $ZONENAME

zonecfg -z $ZONENAME -f $CMDFILE

if [ $? -ne 0 ]

then

echo

echo "PROBLEMS WHEN MODIFYING ZONE $ZONENAME !!"

echo

else

echo

echo "ZONE $ZONENAME MODIFIED."

echo

;;

echo "Adding of /var FS not requested."

;;

echo "Unable to determine if /var FS is requested or not."

esac

done

echo

root@sun15k-b #

You need to check new BE's /etc/vfstab file. There could be “/zones/<zone-name>/root/var” entreries. This is result of lucreate process which has no special handling of local zones “/var” FSs and treats them as standard data FSs. This enteries in /etc/vfstab will prevent your local zones from booting as zone boot process need to mount local zone's /var FS itself.

When you have fixed all zones /var problem zones' FS should look like this:

root@sun15k-b # df -lhZ | grep zone

/dev/md/dsk/d2103 7.9G 5.4G 2.4G 69% /zones/cozone03

/dev/md/dsk/d2101 7.9G 6.0G 1.8G 77% /zones/cozone01

/dev/md/dsk/d2102 7.9G 7.1G 695M 92% /zones/cozone02

/dev/md/ora_dg/dsk/d500 963M 601M 304M 67% /zones/cozone01/root/app

/zones/cozone01/dev 7.9G 6.0G 1.8G 77% /zones/cozone01/root/dev

/dev/md/dsk/d107 469M 1.3M 420M 1% /zones/cozone01/root/export/home

/dev/md/ora_dg/dsk/d505 963M 601M 304M 67% /zones/cozone01/root/ora01

/export/ora02 963M 601M 304M 67% /zones/cozone01/root/ora02

/export/ora03 963M 601M 304M 67% /zones/cozone01/root/ora03

/export/ora04 963M 601M 304M 67% /zones/cozone01/root/ora04

/export/ora05 963M 601M 304M 67% /zones/cozone01/root/ora05

/export/ora06 963M 601M 304M 67% /zones/cozone01/root/ora06

/export/ora07 963M 601M 304M 67% /zones/cozone01/root/ora07

/export/ora08 963M 601M 304M 67% /zones/cozone01/root/ora08

/dev/md/dsk/d2104 7.9G 415M 7.4G 6% /zones/cozone01/root/var

proc 0K 0K 0K 0% /zones/cozone01/root/proc

ctfs 0K 0K 0K 0% /zones/cozone01/root/system/contract

mnttab 0K 0K 0K 0% /zones/cozone01/root/etc/mnttab

objfs 0K 0K 0K 0% /zones/cozone01/root/system/object

swap 14G 320K 14G 1% /zones/cozone01/root/etc/svc/volatile

/zones/cozone01/root/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap1.so.1 7.9G 6.0G 1.8G 77% /zones/cozone01/root/platform/sun4u-us3/lib/libc_psr.so.1

/zones/cozone01/root/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap1.so.1 7.9G 6.0G 1.8G 77% /zones/cozone01/root/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1

fd 0K 0K 0K 0% /zones/cozone01/root/dev/fd

swap 14G 0K 14G 0% /zones/cozone01/root/tmp

swap 14G 32K 14G 1% /zones/cozone01/root/var/run

/zones/cozone02/dev 7.9G 7.1G 695M 92% /zones/cozone02/root/dev