Comments on: How cachable is google (part 2) - Youtube content

By: chudycebu

chudycebu — Fri, 08 Feb 2008 16:40:37 +0000

I’ve been trying to look for this squid that has this storeurl_rewrite features and found out that is still on development. Currently using Windows XP squid-2.6.STABLE18 (10 Jan 200

I just want to cache the youtube videos (bec its #1 bandwidth sucker and #2 is the imeem) refresh pattern get_video just works fine for 3years until last thursday. Youtube has been upgraded their url video files.

They add signature, your ip, ipbits, expire, and key in url video files. so it no longer be cache bec signature always change. so i try to use urlrewrite temporarity until storeurlrewrite feature is up.

$| = 1;

while () {
chomp;
# print STDERR $_ . “\n”;
if (m/^http:\/\/([A-Za-z]*?)-(.*?)\.(.*)\.youtube\.com\/get_video\?video_id=(.*)\&signature=(.*)\&ip=(.*)\&ipbits=(.*)\&expire=(.*)\&key=(.*) /) {
print “http://” . $1 . “-” . $2 . “.” . $3 . “.youtube.com/get_video?video_id=” . $4 . “\n”;
} elsif (m/^http:\/\/(.*?)\/get_video\?video_id=(.*)\&origin=(.*)\&signature=(.*)\&ip=(.*)\&ipbits=(.*)\&expire=(.*)\&key=(.*) /) {
print “http://” . $3 . “/get_video?video_id=” . $2 . “\n”;
} else {
print $_ . “\n”;
}
}

i just bypass the CDN network and use the origin url from youtube.
if the storeurlrewrite feature i really love to cache imeem(which is the #2 most annoying bandwidth sucker)

By: Adrian Chadd

Adrian Chadd — Tue, 25 Dec 2007 15:03:59 +0000

The legality isn’t my concern really. This stuff isn’t prefetching Google Earth, nor is it distributing “map packs” to make things faster. Its simply caching the content like any other content. Google isn’t specifically trying to make the map tile images uncachable.

By: phreaki

phreaki — Thu, 20 Dec 2007 03:25:24 +0000

Thanks for working on this very important task!

Small and third pipe operators need this type of caching to offset P2P, so I’ll be trying this method out soon.

I ponder however: Google Earth? I don’t know if it uses SSL, but others have gotten into trouble for making ‘map packs’. I hope the DMCA could protect like it’s intended for those that try to make everything uncacheable.