About this site

Prev

Next

1994

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

About

   

Deep Linking

Monday, August 9, 1999 by Dave Winer.

***Good afternoon DaveNet readers! Permalink to ***Good afternoon DaveNet readers!

Late last week, rain! Summer rain is so rare here. Big New Orleans thunder clouds in our little desert. In its aftermath the air is left bright, as if all the colors were turned up, like seeing with new eyes."Everything's so pretty!" I said so many times. Permalink to Late last week, rain! Summer rain is so rare here. Big New Orleans thunder clouds in our little desert. In its aftermath the air is left bright, as if all the colors were turned up, like seeing with new eyes.

***Deep linking Permalink to ***Deep linking

As I was driving around the Bay Area this weekend, I thought about the Deep Linking issue raised in a lawsuit by Universal Studios, and reported by Wired News last week: Permalink to As I was driving around the Bay Area this weekend, I thought about the

http://www.wired.com/news/news/politics/story/20948.html  Permalink to http://www.wired.com/news/news/politics/story/20948.html

What is a deep link? It's such a new term, there is no accepted definition. So I'm going to offer one. A deep link is a publicly accessible HTML "anchor" tag that points to an off-site web page that is not the home page of the site being pointed to. Permalink to What is a deep link? It's such a new term, there is no accepted definition. So I'm going to offer one. A deep link is a publicly accessible HTML

So, for example, the link to the Wired story above is a deep link.  Permalink to So, for example, the link to the Wired story above is a deep link.

***Wired probably won't sue Permalink to ***Wired probably won't sue

I am fairly sure that Wired will not sue me for linking to their story. In fact, I imagine that they are pleased to have their story pointed to because the page contains several advertisments that they make money from.  Permalink to I am fairly sure that Wired will not sue me for linking to their story. In fact, I imagine that they are pleased to have their story pointed to because the page contains several advertisments that they make money from.

Their whole purpose, from a business standpoint, is to get eyeballs to see those ads. Further, the page contains links to other Wired stories, and to the Wired home page, if you want to know more about them, or even bookmark them. Permalink to Their whole purpose, from a business standpoint, is to get eyeballs to see those ads. Further, the page contains links to other Wired stories, and to the Wired home page, if you want to know more about them, or even bookmark them.

In the web world this is called "flow" -- and it's good for business.  Permalink to In the web world this is called

Flow is good, and therefore in this context so is deep linking. Permalink to Flow is good, and therefore in this context so is deep linking.

***When deep linking may be unfair Permalink to ***When deep linking may be unfair

Universal's website is different from Wired's. Among other things, they use their site to serve movie trailers, short segments of video that promote their movies. It's a form of advertising. But they are huge files, often several megabytes, and serving them costs a lot of money because you need really big pipes to carry all that video. Permalink to Universal's website is different from Wired's. Among other things, they use their site to serve movie trailers, short segments of video that promote their movies. It's a form of advertising. But they are huge files, often several megabytes, and serving them costs a lot of money because you need really big pipes to carry all that video.

***Movie-List Permalink to ***Movie-List

Enter Jean-Pierre Bazinet, the owner of the Movie-List website, which he calls "the net's most updated movie trailer site": Permalink to Enter Jean-Pierre Bazinet, the owner of the Movie-List website, which he calls

http://www.movie-list.com/  Permalink to http://www.movie-list.com/

Movie-list is a very simple weblog, a news oriented website. People who want to keep up on the latest movies, or research older ones, tune in to Movie-List. He filters out the corporate stuff, and just shows you the product (this is what Universal objects to). Permalink to Movie-list is a very simple weblog, a news oriented website. People who want to keep up on the latest movies, or research older ones, tune in to Movie-List. He filters out the corporate stuff, and just shows you the product (this is what Universal objects to).

Bazinet was pointing to the Universal trailers directly, without pointing to the Universal home page, or even the page with the description for each movie. Universal says this is unfair and illegal. Permalink to Bazinet was pointing to the Universal trailers directly, without pointing to the Universal home page, or even the page with the description for each movie. Universal says this is unfair and illegal.

It's difficult to understand why Universal is objecting, since the trailers sell tickets and video rentals of their movies. However, the trailers are their intellectual property, so they certainly have the right to raise the question. And it's an interesting question because there is a technical solution, this does not have to be resolved thru a lawsuit. Permalink to It's difficult to understand why Universal is objecting, since the trailers sell tickets and video rentals of their movies. However, the trailers are their intellectual property, so they certainly have the right to raise the question. And it's an interesting question because there is a technical solution, this does not have to be resolved thru a lawsuit.

***robots.txt Permalink to ***robots.txt

In the early days of the web the Robot Exclusion Protocol became the accepted way for a website to declare its willingness to be scanned by a search engine or other kinds of web "crawlers."  Permalink to In the early days of the web the Robot Exclusion Protocol became the accepted way for a website to declare its willingness to be scanned by a search engine or other kinds of web

http://php.iupui.edu/~lzick/l505/sre.htm  Permalink to http://php.iupui.edu/~lzick/l505/sre.htm

If you don't mind being crawled, you don't have to have the robot file, robots.txt. But if you have one, all robots are supposed to read it and and thru the honor system, respect it. If they say they don't want to be crawled, then don't.  Permalink to If you don't mind being crawled, you don't have to have the robot file, robots.txt. But if you have one, all robots are supposed to read it and and thru the honor system, respect it. If they say they don't want to be crawled, then don't.

Robots.txt is like a big "People Only" sign. Permalink to Robots.txt is like a big

***deepLinks.txt Permalink to ***deepLinks.txt

The Deep Linking issue can be settled in a similar manner. Permalink to The Deep Linking issue can be settled in a similar manner.

I propose a file called deepLinks.txt. It says whether or not links are permitted into the website, and further, if linking is permitted, it says which sub-directories may be linked to.  Permalink to I propose a file called deepLinks.txt. It says whether or not links are permitted into the website, and further, if linking is permitted, it says which sub-directories may be linked to.

It's a clear statement of intention -- anyone linking into a not-permitted location is clearly wrong. Further, the policy could be implemented by software running on your server. With a few technical tricks, Universal could make it impossible for Movie-List users to watch the trailers. But the deepLinks.txt file would be the professional and respectful way to let the outside world know that you don't want their flow. Permalink to It's a clear statement of intention -- anyone linking into a not-permitted location is clearly wrong. Further, the policy could be implemented by software running on your server. With a few technical tricks, Universal could make it impossible for Movie-List users to watch the trailers. But the deepLinks.txt file would be the professional and respectful way to let the outside world know that you don't want their flow.

If you don't have a deepLinks.txt file, then any and all linking is permitted. This would allow the web, by default, to retain its current open-linking tradition, which is essential if the web is to retain its charm. Permalink to If you don't have a deepLinks.txt file, then any and all linking is permitted. This would allow the web, by default, to retain its current open-linking tradition, which is essential if the web is to retain its charm.

***Dave Winer Permalink to ***Dave Winer



© Copyright 1994-2004 Dave Winer. Last update: 2/5/07; 10:50:05 AM Pacific. "There's no time like now."