Apr 5, 2013 - It was Sun Storage Appliance 7000 Analytics. Now called Oracle ZFS Storage Appliance Analytics. In particular, I was showing heat maps of disk I/O latency - which are crucial for examining the full distribution of latency over time. Similar heat maps are now in Joyent Cloud Analytics. In both cases they used DTrace to fetch the data.
Apr 5, 2013 - I explained the story in another video on youtube, titled "The Making of Shouting in the Datacenter" (comments won't let me include the link)
Apr 5, 2013 - no, I've spoken to hard drive manufacturers about it - load noises or vibrations are a well known problem for rotational disks. If you'd like to read more about it, look up "Effects of Data Center Vibration on Compute System Performance" by Julian Turner, USENIX, 2010.
Mar 19, 2013 - It's amazing to me how much basic science we need to do in our field. Have you tried isolating the noise with different noise makers? For example: a fog-horn from 3 feet versus a speaker.
Mar 10, 2013 - It's not that you are shouting at them, it is that your hands hit them when you put them up against the enclosure. That is the main vibration source and it explains why the spike is shorter than the time you shouted for, especially the second attempt.
Feb 23, 2013 - Hard drives have voice coil actuator for the heads positioning. These actuators position the motor like the baffle of a loudspeaker, so there is the name - voice coil
Jan 24, 2013 - The software is a customized version of OpenSolaris/Solaris 11.
It's pre-installed on Sun/Oracle storage appliances. As far as I know, it's not available for use on other hardware. If you have to ask how much they cost, you can't afford them.
Jan 23, 2013 - OK, what I want to know is, how on earth did they discover this? Did somebody just happen to be looking at disk benchmarks when at the same time a disgruntled worker yelled at his boss who happened to be standing next to the JBOD at the time, or something like that?
Jan 11, 2013 - HAHA.. Nice. I'll add hard drives along with spiders to the list of things I've learnt don't like being yelled at from watching youtube videos.
PS Bit of a random blast from the past: bumped into Brendan back when I used to do training for sun.
Dec 10, 2012 - Vibration, and noise, which is a form of vibration has been known for a long time to influence disk activity. With SSDs, this will all go away.
Video Details
Brendan Gregg from Sun's Fishworks team makes an interesting discovery about inducing disk latency. For more details, see Brendan's blog entry: http://blogs.sun.com/brendan/entry/unusual_di sk_latency More
Post a comment
Local Comments (0)
Youtube Comments (617)
Chris Sherlock Says:
May 14, 2013 - Hi Brian, have you ever kissed a girl? For real?
Dylan Coulston Says:
May 12, 2013 - haha good video!
James Bos Says:
Apr 6, 2013 - If being a sys admin doesn't work out, you have a promising career ahead of you as a hardcore singer!
Brendan Gregg Says:
Apr 5, 2013 - It was Sun Storage Appliance 7000 Analytics. Now called Oracle ZFS Storage Appliance Analytics. In particular, I was showing heat maps of disk I/O latency - which are crucial for examining the full distribution of latency over time. Similar heat maps are now in Joyent Cloud Analytics. In both cases they used DTrace to fetch the data.
Brendan Gregg Says:
Apr 5, 2013 - I explained the story in another video on youtube, titled "The Making of Shouting in the Datacenter" (comments won't let me include the link)
Brendan Gregg Says:
Apr 5, 2013 - no, I've spoken to hard drive manufacturers about it - load noises or vibrations are a well known problem for rotational disks. If you'd like to read more about it, look up "Effects of Data Center Vibration on Compute System Performance" by Julian Turner, USENIX, 2010.
Shawn Hartsock Says:
Mar 19, 2013 - It's amazing to me how much basic science we need to do in our field. Have you tried isolating the noise with different noise makers? For example: a fog-horn from 3 feet versus a speaker.
windows7rocks1 Says:
Mar 10, 2013 - It's not that you are shouting at them, it is that your hands hit them when you put them up against the enclosure. That is the main vibration source and it explains why the spike is shorter than the time you shouted for, especially the second attempt.
Marcio Y Says:
Feb 23, 2013 - Hard drives have voice coil actuator for the heads positioning. These actuators position the motor like the baffle of a loudspeaker, so there is the name - voice coil
TheVideoSupreme Says:
Jan 30, 2013 - not on mine, maybe it's because you were listen to jbiebs earlier?
Stone Says:
Jan 24, 2013 - What if you were the IT manager? I would want to know how much they cost.
Kevin Trumbull Says:
Jan 24, 2013 - The software is a customized version of OpenSolaris/Solaris 11. It's pre-installed on Sun/Oracle storage appliances. As far as I know, it's not available for use on other hardware. If you have to ask how much they cost, you can't afford them.
Donald Burr Says:
Jan 23, 2013 - OK, what I want to know is, how on earth did they discover this? Did somebody just happen to be looking at disk benchmarks when at the same time a disgruntled worker yelled at his boss who happened to be standing next to the JBOD at the time, or something like that?
Maxim Kouprianov Says:
Jan 13, 2013 - DTrace dtrace dot org/blogs/brendan/2008/12/31/unusual-disk-latency/
NathanAndBike Says:
Jan 11, 2013 - HAHA.. Nice. I'll add hard drives along with spiders to the list of things I've learnt don't like being yelled at from watching youtube videos. PS Bit of a random blast from the past: bumped into Brendan back when I used to do training for sun.
ahuachapan2 Says:
Jan 7, 2013 - No dildos and vibrators at work.
danieladaniela1972 Says:
Jan 2, 2013 - SSD +1 !!!! Please tell us the HDD monitoring software you are using.
CyberneticArts Says:
Dec 29, 2012 - This is incredible!
Tales Teixeira Says:
Dec 20, 2012 - What monitoring software are you using?
DWindustries Says:
Dec 12, 2012 - That comment was a year ago dude, before the update...
Jake Kearns Says:
Dec 12, 2012 - related videos are personalized.. someone that uses your computer likes selena gomez?
jhspooner Says:
Dec 11, 2012 - Leo laport
Ivan Lezhnjov IV Says:
Dec 11, 2012 - hahaha I laughed my ass off at this xD
SaulGoode123 Says:
Dec 10, 2012 - Maybe if you play her music it causes the same effect?
shades2 Says:
Dec 10, 2012 - Vibration, and noise, which is a form of vibration has been known for a long time to influence disk activity. With SSDs, this will all go away.