13

How To Find Out The Number Of Videos On Youtube


Posted by Artem Russakovskii on August 14th, 2008 in Technology
Share

Updated: September 16th, 2012

image According to Wikipedia, in April 2008, the number of videos on Youtube was 83.4 million (ref: http://en.wikipedia.org/wiki/YouTube#cite_note-5). However, the link in the cite note now displays “*” video results 1 – 20 of millions, without showing the real count.

Here's one way I found to get an estimated, but relatively accurate, number of videos on the popular video sharing site Youtube. The idea is simple. Get this feed: http://gdata.youtube.com/feeds/api/videos/-/* and parse out the number inside the <opensearch:totalresults> tag.

So here it is: the number of videos on Youtube is currently fluctuating between about 141 million and 144 million. The number goes up and down, which points to the fact that these are estimates.

That's a whole boatload of video if you ask me. To put it into perspective, a modest and completely inaccurate estimate of the amount of space all these videos occupy would be something like

142,500,000 * (a + b + c + d), where

  • a = average size of an FLV, let's say 4MB, though I'm probably way off. There are lots of really short videos out there and Youtube has a 10 minute cap. It's just an estimate, anyway.
  • b = average size of an MP4, let's say the same 4MB. There are lots of factors that would make this number completely inaccurate, the biggest one being I don't know at which point Youtube started generating MP4s and if they generated them for all videos or just the ones going forward). It also depends on whether they managed to save all originals that people uploaded.
  • c = average size of all images associated with the video, let's say 50KB. Small thumbnails and a larger first frame don't take that much space.
  • d = average size of an original uploaded to Youtube. These could be immediately discarded after the encoding is complete, or perhaps Youtube saves the past few months worth, or if they're completely insane, they're saving ALL originals ever. I'm going to throw a semi-random number in – 50MB per file.

So, just the FLVs, MP4s, and images would equal ((4 MB) + (4 MB) + (50 KB)) * 142 500 000 = 1.06818788 petabytes.

If Youtube has been saving all originals since the beginning, this number goes up to ((4 MB) + (4 MB) + (50 MB) + (50 KB)) * 142 500 000 = 7.70386123 petabytes.

In addition to the video files, I wonder how big Youtube's databases are. Depending on how the data is compacted over time (i.e. daily views folded into monthly after a month, monthly into yearly, etc), I would estimate something along the lines of 1.5-2TB, which is negligible compared to the space needed for videos. I'm quite sure the databases are mysql, split into many shards for better performance, perhaps tweaked with Google patches. Watch Youtube's Scalability Presentation and have a peak at this article for more info.

So there you have it, folks. Am I far off in my calculations? If so, don't hesitate to correct me.

Edit: It seems that I forgot that Youtube also generates 3gp, so add some space needed for that.

● ● ●

Artem Russakovskii is a San Francisco programmer, blogger, and future millionaire (that last part is in the works). Follow Artem on Twitter (@ArtemR) or subscribe to the RSS feed.

In the meantime, if you found this article useful, feel free to buy me a cup of coffee below.



Share
  • http://beerpla.net Artem Russakovskii

    Thanks to whoever translated and posted this at http://habrahabr.ru/blogs/youtube/37033 (from what I can tell, it's quite popular in Runet).

    The article mentions 2006 in the first paragraph, while in reality it should be 2008.

    Also, I can't seem to register on the site to post a few comments :( Knock-knock, is anyone there?

  • Dwiki

    Couldn't you just take the hours and hours to scroll to the very end of the search results? Might take days, but you will get an answer :)

    Brute force approach is my favorite.

  • http://beerpla.net Artem Russakovskii

    Dwiki, youtube caps the search results at a certain number, so that approach wouldn't work.

  • http://beerpla.net Artem Russakovskii

    It looks like the number in the feed is now capped at 1,000,000. That is quite unfortunate, perhaps Google doesn't want this information public anymore.

  • mp4todvd

    Thank you for your tips on youtube. I will keep it for future use.

  • carl

    does anyone have an idea of what video has the most number of posting in youtube…thanks

  • Roger

    Do you think there's a way to find out how many of YouTube's videos are embedded off the YouTube domain (onto user blogs, etc.)?

  • John

    The possibilities of the internet are unlimited. I can't imagine what the internet will be like in 10 years.

  • http://www.dogheartstudios.com/dancingfrogsreadingroom/?p=144 Dave

    I'm looking for a video of me drinking Schlitz Beer while tap dancing and wearing a pink tutu… I heard that it's gone viral. I don't remember doing it, but my friends swear I did. Too many beers I guess.

  • Jackygame

    How many hard disks does Youtube have?
    :)

  • strahovak

    really iteresting, thanks. When I guess one minute as an average length of video, It makes 142 500 000 minutes, 2 375 000 hours, 98 958 days and 271 years of video. nice

  • Chris
  • tom

    XD i was right my friend thinks its 60 gbs because a 100 year old told him so