No Time For Narrative – Solaris 11 Express ZFS and NFS share to VMWare ESXi 4.1u1
Welcome to my scratchpad. See links for some excellent write ups.
This article is based on Solaris 11 Express and VMWare ESXi 4.1.
Step 0: Build your hardware and install Solaris.
HCL: http://www.oracle.com/webfolder/technetwork/hcl/index.html
Step 1: Mirror the rpool
zpool status #figure out what’s already allocated
cfgadm -s "select=type(disk)" #list disks
fdisk -W - [rootdisk2] #check
fdisk -B [rootdisk2] #apply a default Solaris partition to the disk
fdisk -W - [rootdisk2] #check again
prtvtoc /dev/rdsk/[rootdisk1] | fmthard -s - /dev/rdsk/[rootdisk2] #slice and dice! You must define slices for rpools, so this step mirrors the original disk’s slice-age to the second root disk
zpool attach -f rpool [rootdisk1] [rootdisk2] #attach, not add. Attach = mirror. Add = stripe.
zpool status #check
installgrub /boot/grub/stage1 /boot/grub/stage2 /dev/rdsk/[rootdisk2] #install grub onto second boot disk
zpool status #check again
see: http://constantin.glez.de/blog/2011/03/how-set-zfs-root-pool-mirror-oracle-solaris-11-express
For more on rpool manipulation, namely on how to shrink an rpool, see: http://blogs.oracle.com/mock/entry/how_to_shrink_a_mirrored
Step 2: Configure networking
ifconfig -a #cheat and take advantage of nwam’s device lists
svcadm disable network/physical:nwam #disable nwam
svcadm enable network/physical:default #then enable the default config tools
ipadm create-if e1000g0 #or whatever your nic is
ipadm show-if #check
ipadm create-addr -T static -a mg.mt.ip.addy/prefix e1000g0/v4 #create the address
ipadm show-addr #confirm
#link aggregate group (LACP)
dladm create-aggr -l [nic2] -l [nic 3] #create link aggregate group:
Then the same ipadm commands
ipadm create-if aggr1 #configure aggr1 for persistence
ipadm show-if #confirm it was added, should show down.
ipadm create-addr -T static -a 1.2.3.4/24 aggr1/v4 #create the address
ipadm show-addr #confirm it was added, show-if should now show “OK”
netstat -rn #check routing tables
route -p add default 1.2.3.1 #add persistent default route
vi /etc/resolv.conf #configure nameservers
vi /etc/hosts #configure name
vi /etc/nsswitch.conf #enable dns lookups for “hosts” line
svcsadm restart ssh #restart ssh after modifying networking
ping 4.2.2.1 #ping Level3′s DNS resolvers to confirm routing
reboot #reboot to confirm persistency
Step 3: Do your AD thing. I know you love it.
read this: http://blog.scottlowe.org/2006/08/15/solaris-10-and-active-directory-integration/
also: http://download.oracle.com/docs/cd/E19963-01/html/821-1449/index.html
Step 4: Configure ZFS
format #to present list of disks. exit out, leaving the list in screen buffer
or: cfgadm -s "select=type(disk)"
zpool create tank mirror c7t0d0 c7t1d0 mirror c7t2d0 c7t3d0 cache c7t4d0 #create your main zpool. This is 4 drives in raid 10 and a read cache. use “log c#t#d#” to add a ZIL device
zfs set dedup=on tank #enable dedup
zfs set compression=on tank #enable compression.
Note that changes made to the pool will apply to its children when they are created.
zfs create tank/VMOS #create your ESXi share
zfs set sharenfs=none,nosuid,root=1.2.3.xx:1.2.3.xy tank/VMOS #share with 1.2.3.xx and 1.2.3.xy
From esxi 4.1:
esxcfg-nas -a -o IP.Or.Host.Name -s /tank/VMOS [esxiDatastoreName]# http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1005057
ZFS /Solaris links
http://lildude.co.uk/zfs-cheatsheet
http://download.oracle.com/docs/cd/E19963-01/index.html
iSCSI - Solaris 11 = use COMSTAR.
Useful! Find a table from a column name
SELECT name FROM sysobjects WHERE id IN ( SELECT id FROM syscolumns WHERE name like '%PART_OF_NAME%' )
From: http://snippets.dzone.com/posts/show/2035
Dropbox for Teams
WHAT?! https://www.dropbox.com/teams. Just click on it.
This is Awesome-Sauce in response to user requests for enterprise ready dropbox, Dropbox for Teams allows IT organizations to deploy dropbox to end users in SAAS fashion.
That being said, I’ve been short on posts lately on account of some severe workload. Will post more soon.
dropbox.com
I wanted to bring up Dropbox.com to your attention. I wanted to share what I thought was a fantastic company that’s basically taken the concept of JungleDisk and moved it one step further. How? Instead of really cheap (Jungledisk), dropbox is free for the first 2 gigs. This, combined with the below usability features, results in rapid growth in user adoption. As of January, the company has over 4 million users. That’s over 8 Petabytes of potential disk space usage if every user was a free 2GB plan.
All of the public infrastructure is hosted at AWS, and can thus scale with the userbase. As Amazon charges anywhere from $0.055 to $0.150 per GB (pricing structure), each free user consumes from $0.11 to $0.30 per month. Even with 6.25% utilization of 8 Petabytes, Dropbox.com pays the $0.105 per GB rate, Given their next paid upgrade is for 50 GB and costs $9.99/month, one paid customer can support the storage fees for up to ($9.99 − 50 clients × $0.105) ÷ $0.21 = 22 clients covered in the cost of a single paid user, at full utilization of each user. However, most users won’t be using their full utilization (think Google mail), and their business model becomes more lucrative.
Starting with dropbox is simple. Download the client, register your account, and a folder is created where you can drag and drop your data. All data in this folder is replicated to dropbox servers, and to all dropbox client nodes that you link to your account.
The application ships with an intuitive user interface (no S3 accounts to configure, as this is done for you), and a rich feature set that includes automatic versioning, automatic syncing, cross-platform compatibility, intuitive web publishing, and a simple pricing model.
The one feature that really stood out however, was how they garner feedback for this actively developed product. Users can navigate to https://www.dropbox.com/votebox, where they can submit suggestions that get voted on and commented upon. This popularity contest likely helps the company focus on what projects need developing next.
All in all, this is an exciting company to be a customer of, and I would recommend y’all take a look at it too, as this appears to be what proper execution of a good idea looks like.
Kudos dropbox.com on a product well done.
Setting up Hyper-V with NAT
This post was originally posted by me at http://forums.serverbeach.com/showthread.php?t=6411.
I’ve edited out the ServerBeach specific stuff and will post pictures…. soonish.
The following link has some great pictures not included here. http://sqlblog.com/blogs/john_paul_c…h-hyper-v.aspx
I’ll add some nice little pictures here once I get some screenshots together.
CONFIGURE HYPERV
1. Configure an “Internal” HyperV network
2. Set each Virtual Machine to use the Internal network and assign them and your HyperV host on the correct subnet (in this example 10.0.0.1 for the host and 10.0.0.10 for the VM).
ENABLE ROUTING AND REMOTE ACCESS ON THE HOST MACHINE
1. Click -> Start -> Administrative Tools -> Routing and Remote Access
2. Right Click on Server#### (local) -> Configure & Enable Routing & Remote Access
3. Click -> Next on Welcome Window
4. Select Custom Configuration Click -> Next
5. Select NAT Click -> Next
6. Select your public interface
7. Select your Internal HyperV interface
8. Select “I will set up name and address services later” Click -> Next
9. Click -> Finish
CONFIGURE ROUTING AND REMOTE ACCESS ON THE HOST MACHINE
1. Routing and Remote Access should be running on the server now
2. Expand out the Server
3. Expand out IP Routing
4. Select NAT/Basic Firewall
5. Right-click your public interface. Select properties
7. Network Address Translation Properties Window will open
8. Select Radio Button for “Public Interface Connected to the Internet”
9. Select the check box for both “Enable NAT on this interface”
10. Click on the Address Pool Tab
11. Click the Add button and add your secondary IP addresses. The “Start Address” and “End Address” will be the same in most cases.
*NOTE* You do not want the secondary IP address configured in the TCP/IP Properties of the Host machine.
12. Click the Reservations button and enter your static IP mappings. That is, specify that you want traffic on your secondary IP mapped to your VM’s internal IP.
13. In services.msc, make sure that RRAS is set to start automatically and Windows ICS is disabled.
NOTES #1
When configuring and experimenting with the RRAS firewall, create a batch file to stop the service in case you forget to allow RDC or otherwise render the system inaccessible.
Code:
net stop “remoteaccess”
Then add the batch file to the scheduler and have it run some time after you apply your changes.
NOTE #2
RRAS is really finicky about the interfaces installed on the server. If an interface is changed in any significant way, it’ll have to be disabled and reconfigured.
Hyper-V is also similarly finicky about its virtual networks. I can’t count the number of times I had to remove and recreate networks. Thankfully, this was rather painless with only one VM to propagate changes to.
If you should encounter any difficulties with adding your additional VMs to the server, try resetting HyperV networking, individual VM network binding (in the VM’s settings), confirming physical host interfaces, and then reconfiguring RRAS in this order.
NOTE #3
Those who have had HyperV configuration problems solved it by disabling TCP/Offload Engine. Symptoms include, RRAS just not working, or working sporadically. If in doubt, disable TCP/Offload Engine
http://social.technet.microsoft.com/…8-d22aca6154ee
http://support.microsoft.com/default…b;EN-US;904946
So if this applies to you, run on the host and on any 2008 VMs:
$ netsh int ip set global taskoffload=disabled
and add the following registry key to any 2003 VMs:
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Servic es\Tcpip\Parameters\DisableTaskOffload
This is a DWORD entry that should have a value of 1.
