The 3E’s of Storage: Efficient, Effective, and Easy

youarekiddingmeI was just doing some basic research on creating a PowerShell script that would determine data change rates for a VM or a group of VM’s and came across this post by @Cocquyt on the Netapp forums which got my brain into one of these I need to write about this loops.

How to determine which VM’s (NFS files) are contributing the most to snapshot deltas?  Hi – we have a 3.5Tb NFS datastore running about 30 vmware virtual machines. We try to maintain 21 days of daily netapp snapshots, but lately the daily deltas are > 100gb/day and its becoming challenging to keep 21 days without growing the volume. (the data:snapshot space ratio is about 1:2 – the snapshots take twice as much space as the actual VM images – and this is with dedup ON) How can we best determine which set of the VMs is contributing the most to the daily snapshot delta (that 100Gb)? Armed with this information we can then make decisions about potentially storage vMotioning VMs to other datastores to meet  the 21day retention SLA.

Wow, that sounds like a massive pain in the ass to deal with. You dig a little further in the post and you can see just how convoluted the solution could be especially when you look  to see what recommendations are made by the forum posters. In my past life as a simple admin/engineer running storage and virtualization, I could spend 20% of my day doing exactly this type of work. Trying to solve a problem via google. Reading and posting in forums, asking friends, calling the vendor or VAR. Essentially wasting productivity that should have been dedicated to enabling the business, on problems created by the limitations and complexity of the tools I had at my disposal. To me, that hits at the list of things I consider “Not Optimal”, and for the most part, overly complex.Complexity-2

Just so you know, I’m not picking on Netapp here, the issues faced in that post are going to apply to a large swath of storage companies and their arrays. The post is from 2011, and I’m not a Netapp expert so I don’t know how much better the process has gotten, but to me it illustrates a pain point for many organizations running some of the legacy storage platforms whose general foundational technologies were designed in the early to mid-90’s.

When those systems were architected, designed, and  deployed years ago they were probably state of the art, and at that time, the convoluted, complex, and cumbersome configuration was considered part of doing business.

Few if any systems fit my 3E’s of being Efficient, Effective or Easy when it came to storage deployments at that time. Great consideration would have been given in regards to how to lay out the underlying disk, the size and speed of the disks, the RAID sets, disk, LUN sizes, zoning, HBA firmware and compatibility, switch settings, multi-patching software, thin provisioning limits, page sizes, snapshots, clones, etc. etc. etc.

istock_000012210065mediumWhat is interesting to me today, is that there are still a large number of customers who still rely on those legacy platforms for their production environments. I’m guessing if they have a 5 year old platform still being utilized today, they are probably looking at the next generation version of those products  to replace the older platforms. Yet even though the model numbers may have changed and the bezels are newer,  some of those limitations from the initial design of those systems will carry forward. If they are lucky, some of the complexities from the past have been abstracted away, perhaps the UX allows the abstraction of many of the manual operations, perhaps the algo’s associated with specific functions are quicker, most assuredly the speeds of processes have increased and the number of raw IOPS have gone up as well. But what has not changed are the flaws associated with architectures that were created long ago, and the bottom line is, the 3E’s of Efficient, Effective, or Easy to implement are not being utilized.

Stay tuned, second post to follow on how these 3E’s are being addressed today.

Post Edit to add a hat tip from Christian Mohn @h0bbel, there is another E that can come into play, and that would be Expensive. Though I tend to view the expense of a platform to be a slightly different aspect of this overall discussion, I’ll weave that into the next post as well.

Posted in Storage, Storage & Virtualization | 2 Comments

vExpert Weekly Digest: 6 Months Later

vexpertweeklySo its been a six months now since I started curating the vExpert Weekly Digest magazine on Flipboard on a sometimes weekly basis (life happens). So far its been a pretty interesting experiment in using the platform. To date with 22 Magazine Editions there have been:

  • 707 Subscribers
  • 13156 Articles Flipped
  • 889 Articles Published

Some interesting anomalies. The very first episode had a huge readership turnout, 145 subscribers 2328 articles flipped from 57 articles, I’m guessing that’s about as big a reach as Newsweek magazine if you didn’t count all those doctor offices that subscribe to it.vExpert-1stEd

Then of course the week after was a little more in line with what I was expecting, 27 subscribers, 410 articles flipped from 49 articles. The trend line follows that pattern for the most part with readership going up and down by a few dozen people, etc.

The other outlier was the July 31st edition that just blew up, I’m guessing that could be attributed to VMworld announcements, but honestly I just dont know, there are no real good tracking analytics for Flipboard.vExpert-Edition

75 subscribers, 6668 page flips, with 37 articles. That is a pretty decent amount of turnout.

This of course brings me to my main complaint about the Flipboard format, primarily I can’t create a true subscription model that will follow from edition to edition. Each edition is its own unique construct so if someone follows the week before, they wont be automatically following the week after. In order to see all the magazines you have to subscribe to the user, aka me. I don’t like this aspect of it, but really that’s the only issue I have with the system so far. I’m sure they will work out a way to incorprate those changes into the system some time in the future.

The one nice thing today is that the service has gone online as well as via the app a far broader reach is achievable. Users don’t necessarily have to read the magazine from a tablet. As usual, I hope all the readers find value in the magazine. I’ve gotten some good feedback from the community regarding it, and honestly I kind of like collecting and publishing the articles. So it continues to be one of my contributions to the community.

 

Posted in vExpert-Weekly | Leave a comment

vExpert Weekly Digest, October 1st 2013

vExpert10-1Government shutdown be damned! The vExpert Weekly Digest is here.  Check out whats new in the vExpert community. This week brings lots of updates around 5.5 deployment and best practices, some VCDX info, and lots of VSAN.

Posted in vExpert, vExpert-Weekly, VMWare | Leave a comment

vExpert Weekly Digest – September 25th 2013

vExpertWeekly9-25And We’re Baaack! Better late than never. vExpert Weekly is now out for your reading enjoyment. Please remember to subscribe and check back here weekly for new editions. I’ve really liked the ability to curate the magazine from the web pages instead of from my phone or ipad, its been a very nice update. Lots of new and exciting stuff in the VMware community this week so go take a look.

Posted in vExpert, vExpert-Weekly, VMWare | Leave a comment

Cancer Can Suck IT – Podcasting for Cancer

So I write this while on a plane to Seattle to visit my Mom who is battling Stage IV Lung cancer that has 20130913150122-1600-Podcaster_mountednow spread from the lungs to the spine, and fluids around the brain. This comes just a year after I lost my Father to Liver Cancer. I lost my Grandmother as well as my Grandfather to the disease. Apparently it runs in the family. This is something I must remain mindful of as the years progress. For me “Fuck Cancer” is an understatement.

So not to be “Debbie Downer” there is a silver lining to be had. The technology community that I have ingrained myself in over the last several years has reacted with the same kind of pure intensity, energy, and drive that many of them pour into their love of Virtualization, Computing, and Enterprise Technology, by creating a charity podcast event to help raise money and awareness for Cancer research,

 Podcasting For Cancer.

toosoon

It’s always too soon for cancer, sir.

After this unfortunate tweet an idea was bounced around the vBlogging community: vExperts and vBloggers will get together with vBrownbag and VMUG folks to put on a series of top-notch podcasts on relevant upcoming technologies that affect the visualization industry.  We would stand up a fundraising site with the proceeds going towards a cancer donation in the Chapman family name.

The response to this idea has been overwhelmingly positive.

A simple tweet that I sent out from pure frustration has gained momentum and with the help and effort of some truly amazing people within the community,  has turned into something really astonishing. I would be utterly remiss if I did not heap a huge offer of gratitude and thanks to Trevor Pott,from the Register who goes under the Twitter Handle @cakeis_not_alie and several other members of the vBrownbag, VMUG, and vBlogging Community for throwing their time and effort behind a good cause. It is becoming increasingly difficult to find someone who has not had a form of cancer hit them or a loved one in some way, it is my sincere hope that fewer people in the future will feel its touch.

Posted in Podcasting For Cancer, vBrownbag, vExpert, VMUG, VMWare | 2 Comments

vExpert Weekly Digest – September 9th 2013

9-9-2013 6-08-42 AMFresh off the tubes, this weeks vExpert Weekly Digest has some juice tidbits. The Hands on Labs are now open online, so get your learn on. A good summary on whats new in vCloud Director, as well as a good analysis of vCSA.

This week finds me in Santa Clara for the Software Defined Data Center Symposium put on by Stephen Foskett of GestaltIT and has some great speakers on the panel for which I am very much looking forward to hearing.

Posted in vExpert-Weekly, VMWare | Tagged | Leave a comment

vBrownbag Tech Talk – VMworld 2013 – Hyperconvergence

vbrownbagSo after a week of talking to people for 16 hours a day, I felt that I had 7 more minutes of speech capability left and gave a quick overview of Hyperconvergence during the vBrownbag Tech Talks. If my voice sounds like I had entered a Tom Waits sound-a-like contest its probably because it was on its last legs, and vStogies was the night before.

I’ll have a few posts coming soon that go into further depth regarding the focal points of hyperconverged infrastructure and the pro/con of the platform. As always if you have any questions give me a shout out.

Also if you are one of the 20 people who saw my session, please vote for me on the vBrownbag Tech Talk Session Voting List

Posted in HyperConvergence, VMworld | Leave a comment

Visitor vs Vendor: A tale of two VMworlds

My buddy Gabe Maentz asked me during VMworld this year what it’s like to attend as a Visitor and what its like to attend as a Vendor. I think its a good question because most certainly the show is completely different for each attendee.

IMG_4026I’ve been to VMworld 3 times now, the first time as a general attendee, an experience I wrote about some time ago. The last two times I went as part of the Vendor side, once with Emulex, and most recently with SimpliVity. Even within those two shows as a vendor there were significant differences, so perhaps there will be a post forthcoming that goes into deeper discussion on that front.

Visitor

As a Visitor there were 3 areas of focus for VMworld attendance to which I want to address: 

  1. Learning and Training
  2. Vendor and Product Analysis
  3. Networking

Learning and Training tend to be in my view the primary focal point for a Visitor attendee. The goal for me when attending as a Visitor was to gain knowledge about the newly released products and to attend hands on labs for products for which I did not have access, or the ability to spin up in a home or work lab. There’s also the ability to take beta exams, which can give you a leg up on the upcoming certifications. ProTip:I’d say when crafting your “reason to go letter to your boss” the Learning/Training aspect is one to hint at heavily to help show return on investment for the show. 

Vendor and Product Analysis: this weighs heavily as well, and if you have been to VMworld once, and realize that the sessions are recorded and can be skipped (unless you have a pressing question to ask) and downloaded to watch later, the prime focus may move to Vendor and Product Analysis. As a Visitor, my focal point was to spend a significant amount of time in the Solutions Exchange gathering information about products. I usually made a point of visiting all of the Storage technologies on the floor and getting a good understanding of their products and upcoming releases. I would assume the same is for those Visitors who have a key job requirement to focus on Networking, Server, DevOps, Analytic, etc. It’s not every day that you have all the key vendors in your space in one area at the same time, so its best to make use of those floor hours to gather as much information as possible. This also guarantees that you will be emailed daily for the next century. It’s perfectly ok to decline to be scanned if you are not interested in the product, this is called a self selecting lead in my view and its of no ones benefit to get your name on a list for a product you have no desire or use for. On the flip side, if you have a real interest in the product, make sure you are scanned by the Vendor, and ask for a followup.

Networking: now here is the one aspect that applies to both Visitor/Vendor, networking and meeting with your peers. There is a very social aspect of the VMworld conference, as well as other technology conferences. I’ve commented on the Family Reunion aspect of a show like VMworld where all of your Tech Family is under one roof and you can visit freely. There is also the aspect where I make it a point to find 5 people I really wanted to meet and seek them out, as well as 5 people I’ve never met before and engage. This is a great way to step outside your comfort zone and challenge yourself, its also a great way to make some great new friends and build your own personal network of technology professionals that you can draw upon. This is part of the ongoing learning process for technologists, and building relationships with Vendors and other Visitors is key to long term success.

Vendor

Now as a Vendor there is some cross pollination of those 3 items. Depending on your schedule and I’d say the maturity and size of the company you work for you may have time to address the 3 points above, but I tend to view the role of the Vendor with these 3 items:

  1. Lead Generation and Qualification
  2. Customer Engagement and Retention
  3. Competitor Analysis

Lead Generation & Qualification: booth duty is the primary lead generation activity at any tradeshow in my view. The entire purpose of a show like VMworld is to generate customer leads for the organization, and better yet, qualify those leads so that the sales team can engage potential customers. For the Visitor, this show can be about their personal leisure and entertainment, but for the Vendor the show is all business. That’s why you will find me on the Solutions Exchange floor from open to close and after, with breaks only to perform bodily functions and if possible eat. That may seem like a tough gig, the concrete floor is an unforgiving platform for message delivery, and there are probably 10000 tweets about sore feet, but if I am not on the floor to discuss my technology and engage with potential customers, then I’m not doing my job. There is significant planning and expense associated with a show like this, and Mitch & Murray won’t be happy if I can’t generate solid leads. They also won’t be happy if I give them a bunch of leads that are meaningless, so I must engage with Visitors and ask them questions, and then I have to listen. That last point is the most important, because yes I have specific points I want to address when I talk about my technology and provide a demonstration, but it serves us both well if I can focus and tailor that discussion to make it relevant and pertinent to you and your organization. Listen, understand, and engage, that goes for Visitor and Vendor alike.

Customer Engagement  and Retention (aka Wining & Dining): all those Vendor parties you attend as a Visitor are a key focal point for the Vendor side. It’s the time to reward and woo current and potential customers. Dinners, parties, chotchkis, etc. are all part of the effort. Of course this is the worst kept non-secret in existence, but yes the Vendor will attempt to buy his way into your good graces, and the Visitor should know this. I’m not giving up any massive trade secrets here, there is no Vendor’s Guild that will send a silent assassin my way for spilling the beans. Truth be told, in my experience, people buy from people they like, and getting a chance to sit down with your favorite customers is a good time to have some “me time” with them. It may sound orchestrated and a tad devious, but it’s not. For a lot of us in Vendor land, we do build solid relationships with our customers, and an event like this is a time to reward their loyalty and friendship. Before I joined the “darkside” I had crafted some truly great friendships with the sales teams and engineers at several Vendor companies I had done business with, and they remain to this day, even though I actually compete against some of them. It’s part of the Networking side for the Vendor, as much as it is for the Visitor.

Competitor Analysis: (spy vs spy) the final part for the Vendor side is to essentially figure out what the competition is doing, how well they are doing, and how it may impact you and your product/company. Since I work for a startup in a disruptive technology sector, its interesting to see players big and small come by to do a little recon. The larger organizations have the ability to send team members out specifically to get information, a smaller company may have to rely simply on their own team members. There is an aspect to this that can be shady to an extent. I’ve seen vendors swap badges with Visitors to probe for information, enlist their partners to do the same, flip their badges around (thats why you scan everyone in the booth) etc. I’d say its part of the game, but sometimes actions can cross the line (hands off the kit please). I do think that there is something to be said if your primary competitor sends their people to your booth to listen to your pitch and watch your demo, in my view that validates your product. And while we are in competition, it doesnt mean that we are enemies. Off the show floor there is a tentative truce in play where you can all sit down with the members of a competitive team and talk tech over a beer. I try to make a point of engaging with everyone at the show, even if they are a competitor. This is a small industry, you never know who may buy your company, or if you may end up working with someone you once competed against. Treat others as you wish to be treated is a good rule to follow.

Well this post has gone longer than I had anticipated, but I felt that it would be good to do a little brain dump post show. I’ve gotten a lot of feedback from some of my posts about moving to the vendor side of things. I’ve had several good discussions with people who are in the same position I was in a few years ago when contemplating the move to the Darkside. I hope these posts are informative and helpful for you. As usual, if you have any questions, leave a comment, hit me up on Twitter, or shoot me an email.

Not sure if I’m going to Barcelona as of yet, that still remains to be seen. If I do, then there will be a post about the differences between US/EMEA which should be fun.

Posted in Sales Engineering, SimpliVity, VMworld | 1 Comment

vExpert Weekly Digest – VMworld 2013 Edition

9-2-2013 8-40-02 AMWith VMworld 2013 San Francisco having passed this last week, I’ve put together a fine collection of articles from various vExperts from the show. Lots of new and exciting things came out of VMworld US this year, specifically vSAN and NSX.

Posted in vExpert, vExpert-Weekly, VMWare, VMworld | Leave a comment

Going to VMworld? Stop by and see me.

VMworld_Promo_8.13.13So the preparation for VMworld is in full swing with the floor build out starting Thursday around 1PM. It’s always amazing to me how a giant conference hall can go from empty floor space to huge Solutions Exchange in a mere 48 hours. Whats even more impressive is just how good those crane lift drivers are as they navigate a sea of boxes, partially built booth displays, and racks of kit. Imagine if a 747 full of racks of servers, storage,  and vendor displays threw up in a conference hall. Thats what the floor looks like on Friday at noon.

Let me lay out whats going down this week. I’ll be working the booth for SimpliVity where I will be meeting with VMworld attendees and discussing the benefits of our Hyper-Converged Infrastructure building block, the OmniCube. Just last Monday we announced the Second Generation OmniCube platforms which will provide a greater variety of options for customers looking to deploy their virtual infrastructure quickly, efficiently, and with a full compliment of VM-Centric data management, disaster recovery, and mobility options.

BoothBanner

Powering this platform is our OmniStack technology. This is the core technology stack that allows our OmniCube platform to provide in-line deduplication, compression, and optimization of all data in real-time at a very granular level. While the immediate thought that comes to mind with deduplication and compression of data are the space savings aspects, the far more significant result of real time dedupe/compression is the reduction of IO for your workloads. Gene Amdahl put it: “the best IO is the one you don’t have to do”, I would throw onto that, “the one you don’t have to pay for”, but in essence the point that is to be taken away is that reduction of IO for your underlying data infrastructure should be a key tenant of data optimization and management strategies.

Time and energy not spent writing redundant virtual machine data, delta’s of backups, or replicating data that isn’t needed will result in data efficiency that many solutions today cannot offer. Yes we can design a reference architecture, or converged solution that can incorporate parts of this strategy, but ultimately those systems will be limited by the fact that the underlying file system being used was not designed with this functionality at its core. Bolting on a deduplication process after you have already created your base file system isn’t going to be nearly as elegant or efficient, and that is why many solutions that provided deduplication or even compression perform these operations in a post process fashion.

So with that said, this is just the tip of the iceberg, there is much more to discuss, so please swing by our Booth #1023 and hit me or any of the other team members up and we can give you a live demo and overview, you can also register for a demo and get additional chances to win the Car.. And of course the Car, how could I forget that we are giving away an Audi R8 for a year. To bolster your chances to win, come by the booth, get a demo, and come to our Session: VSVC7498 – Deploying The Software Defined Data Center Today—Customer Perspectives and Tips on Optimizing VMware Environments with SDDC  for additional chances to win.

Hope to see you soon.

Posted in HyperConvergence, Omnicube, OmniStack, SimpliVity, VMworld | 1 Comment