postheadericon Diagram: ESX Memory Management and Monitoring v1.0

  • This is the first diagram of more ESX blueprints to come. Previously I was focused more onto the vSphere architectures as a whole, but there will be more granular diagrams on ESX itself as a hypervisor very soon.
  • The colors play a major role in this diagram. I thought I should stick with the original colors used in the vCenter Server Recourse monitoring box (on the top right of the diagram) instead of reinventing the wheel. As an example, if you want to scan through the swapping memory reclamation technique, all what you need is to focus your sight on the red colors. Whether it’s in the VMs, hypervisor, esxtop or vCenter, the red color will always relate to the swapping activity, and so forth.
  • In the MMU virtualization I did not put much detail (as I was hoping to) because of the diagram limited space, but I’m planning to make more detailed diagrams about this topic in the future, along with other technologies like NUMA and EPT/RVI for example.
  • In the memory reclamation techniques, you might have noticed that the “idle memory tax” is not there. I intend to illustrate that in a deferent topic related to shares and resource management.
  • The Memory compression and swapping to SSD are future features coming soon in the vSphere generation. This information was mentioned in the VMworld 2009 session TA2627 so it’s public.
  • The most interesting part for me while creating this diagram was the ESXTOP. I have a wild idea of creating a crazy huge diagram (poster-like) and add the deferent screens and options for ESXTOP along with real-world numbers and descriptions to show the beauty of this incredible tool. I might also use Duncan’s esxtop section as a reference for the thresholds, I urge you to go there and share your experience!
  • For some reason, the PDF converter kept converting the ESXTOP text box into an image and then down-sample it, which ended up not looking as sharp and clean as in the original Visio diagram. I’m trying to figure out why the Acrobat is giving me this grief, so I will probably update the PDF later on (check the version numbers).
  • I’ve received a number of emails asking for some descriptions accompanying my diagrams (like the admission control calculations in the HA diagram), and I believe you are right about that, especially for the newbies entering the fascinating world of VMware. I’ll revisit these diagrams in the future with detailed descriptions and write-ups, so stay tuned.

I hope you’ll like this diagram and see the real beauty of the ESX memory management (well a glimpse of it at least). If you have any corrections or suggestions please drop a comment or email and let me know your thoughts.

Recourses:
- Book: Operating System Concepts (Part Three – Memory Management)
- Book: Modern Operating Systems 3rd Edition (Chapter 3 – Memory Management)
- Documentation: vSphere Resource Management Guide
- WP: Understanding Memory Resource Management in VMwareо ESX™ Server
- WP: Memory Resource Management in VMware ESX Server – by Carl A. Waldspurger
- VMworld2009 Session: TA2963 “esxtop for advanced users”
- VMworld2009 Session: TA2627 “Understanding “Host” and “Guest” Memory Usage and Related Memory Management Concepts”
- Blog: Arnim van Lieshout (Part-1 , Part-2, Part-3)

Share
  • http://www.GabesVirtualWorld.com Gabrie van Zanten

    Great work again!! Keep them coming.

  • Bas

    A picture says more than a 1000 words. Well-done!

  • http://virtualfuture.info/ Matthijs Haverink

    Awesome overview; thanx and keep it up !
    Directly added it to our usefull links section :) .

  • http://www.vReference.com Forbes Guthrie

    This is insanely good. Thanks.

  • imran

    This is amazing. Your deep knowledge of hypervisor technology amazes me.

  • Pingback: Virtualization Short Take #34 - blog.scottlowe.org - The weblog of an IT pro specializing in virtualization, storage, and servers

  • Pingback: ESX Memory Management and Monitoring v1.0 (Diagram) « My blog, My Precious.

  • bettycarson

    Visio Diagrams in 2007 is helps IT and business professionals worldwide visualize, analyze, and communicate complex information, systems, and processes with tools such as HP Visio Stencils.
    These Visio tools also helps you to get real-time data Embed together and program the Visio
    drawing environment to include the power of Visio in any smart client application.

  • Pingback: All things Virtual IV « TheSaffaGeek

  • http://twitter.com/sokratisg Sokratis Galiatsis

    gr8 job! I'd love to print this on a plotter. Is there any way of getting this on a higher resolution? :D

    Thanks in advance!

  • http://www.hypervizor.com Hany Michael

    thanks! the diagram is already designed in high resolution, all the shapes are in victor design, except the two logos (intel & amd). It should print just fine on a large plotter.

  • Pingback: Top 5 Planet V12n blog posts week 03 | VMvisor

  • http://www.filecabinetkey.net/hudson-file-cabinet-keys Hudson File Cabinet Keys

    This is cool! And so interested! Are u have more posts like this? Plese tell me, thanks


My name is Hany Michael, Consulting Architect at VMware. I blog about various topics ranging from the core vSphere technologies all the way to the vCloud based products. (Read more)
Sponsors
Disclaimer
Any views or opinions expressed on this blog are strictly my own and not the opinions and views of my employer.