Archive for the ‘Net Neutrality’ Category

Bandwidth shaping in action, by Comcast

Wednesday, October 24th, 2007

or a few months, there have been rumblings of Comcast, the cable and Internet provider, intentionally disrupting BitTorrent traffic. The Associated Press verified the dusruption by trying to download a copy of the King James Bible via BitTorrent over Comcast-connected computers.

Comcast is apparently using technology from Sandvine to prevent uploading of “torrents,” the special file format used by BitTorrent. Comcast sends faked packets of data to interfere with the transfer. While not illegal, it is a bit sleazy.

Said BitTorrent COO Ashwin Navin to the AP, “They’re using sophisticated technology to degrade service, which probably costs them a lot of money. It would be better to see them use that money to improve service.”

via Valleywag

Comcast blocks some Internet traffic

Friday, October 19th, 2007

Via Yahoo, here, By PETER SVENSSON, AP Technology Writer Fri Oct 19, 9:15 AM ET

NEW YORK - Comcast Corp. actively interferes with attempts by some of its high-speed Internet subscribers to share files online, a move that runs counter to the tradition of treating all types of Net traffic equally.
ADVERTISEMENT

The interference, which The Associated Press confirmed through nationwide tests, is the most drastic example yet of data discrimination by a U.S. Internet service provider. It involves company computers masquerading as those of its users.

If widely applied by other ISPs, the technology Comcast is using would be a crippling blow to the BitTorrent, eDonkey and Gnutella file-sharing networks. While these are mainly known as sources of copyright music, software and movies, BitTorrent in particular is emerging as a legitimate tool for quickly disseminating legal content.

The principle of equal treatment of traffic, called “Net Neutrality” by proponents, is not enshrined in law but supported by some regulations. Most of the debate around the issue has centered on tentative plans, now postponed, by large Internet carriers to offer preferential treatment of traffic from certain content providers for a fee.

Comcast’s interference, on the other hand, appears to be an aggressive way of managing its network to keep file-sharing traffic from swallowing too much bandwidth and affecting the Internet speeds of other subscribers.

Comcast, the nation’s largest cable TV operator and No. 2 Internet provider, would not specifically address the practice, but spokesman Charlie Douglas confirmed that it uses sophisticated methods to keep Net connections running smoothly.

“Comcast does not block access to any applications, including BitTorrent,” he said.

Douglas would not specify what the company means by “access” — Comcast subscribers can download BitTorrent files without hindrance. Only uploads of complete files are blocked or delayed by the company, as indicated by AP tests.

But with “peer-to-peer” technology, users exchange files with each other, and one person’s upload is another’s download. That means Comcast’s blocking of certain uploads has repercussions in the global network of file sharers.

Comcast’s technology kicks in, though not consistently, when one BitTorrent user attempts to share a complete file with another user.

Each PC gets a message invisible to the user that looks like it comes from the other computer, telling it to stop communicating. But neither message originated from the other computer — it comes from Comcast. If it were a telephone conversation, it would be like the operator breaking into the conversation, telling each talker in the voice of the other: “Sorry, I have to hang up. Good bye.”

Matthew Elvey, a Comcast subscriber in the San Francisco area who has noticed BitTorrent uploads being stifled, acknowledged that the company has the right to manage its network, but disapproves of the method, saying it appears to be deceptive.

“There’s the wrong way of going about that and the right way,” said Elvey, who is a computer consultant.

Comcast’s interference affects all types of content, meaning that, for instance, an independent movie producer who wanted to distribute his work using BitTorrent and his Comcast connection could find that difficult or impossible — as would someone pirating music.

Internet service providers have long complained about the vast amounts of traffic generated by a small number of subscribers who are avid users of file-sharing programs. Peer-to-peer applications account for between 50 percent and 90 percent of overall Internet traffic, according to a survey this year by ipoque GmbH, a German vendor of traffic-management equipment.

“We have a responsibility to manage our network to ensure all our customers have the best broadband experience possible,” Douglas said. “This means we use the latest technologies to manage our network to provide a quality experience for all Comcast subscribers.”

The practice of managing the flow of Internet data is known as “traffic shaping,” and is already widespread among Internet service providers. It usually involves slowing down some forms of traffic, like file-sharing, while giving others priority. Other ISPs have attempted to block some file-sharing application by so-called “port filtering,” but that method is easily circumvented and now largely ineffective.

Comcast’s approach to traffic shaping is different because of the drastic effect it has on one type of traffic — in some cases blocking it rather than slowing it down — and the method used, which is difficult to circumvent and involves the company falsifying network traffic.

The “Net Neutrality” debate erupted in 2005, when AT&T Inc. suggested it would like to charge some Web companies more for preferential treatment of their traffic. Consumer advocates and Web heavyweights like Google Inc. and Amazon Inc. cried foul, saying it’s a bedrock principle of the Internet that all traffic be treated equally.

To get its acquisition of BellSouth Corp. approved by the Federal Communications Commission, AT&T agreed in late 2006 not to implement such plans or prioritize traffic based on its origin for two and a half years. However, it did not make any commitments not to prioritize traffic based on its type, which is what Comcast is doing.

The FCC’s stance on traffic shaping is not clear. A 2005 policy statement says that “consumers are entitled to run applications and services of their choice,” but that principle is “subject to reasonable network management.” Spokeswoman Mary Diamond would not elaborate.

Free Press, a Washington-based public interest group that advocates Net Neutrality, opposes the kind of filtering applied by Comcast.

“We don’t believe that any Internet provider should be able to discriminate, block or impair their consumers ability to send or receive legal content over the Internet,” said Free Press spokeswoman Jen Howard.

Paul “Tony” Watson, a network security engineer at Google Inc. who has previously studied ways hackers could disrupt Internet traffic in manner similar to the method Comcast is using, said the cable company was probably acting within its legal rights.

“It’s their network and they can do what they want,” said Watson. “My concern is the precedent. In the past, when people got an ISP connection, they were getting a connection to the Internet. The only determination was price and bandwidth. Now they’re going to have to make much more complicated decisions such as price, bandwidth, and what services I can get over the Internet.”

Several companies have sprung up that rely on peer-to-peer technology, including BitTorrent Inc., founded by the creator of the BitTorrent software (which exists in several versions freely distributed by different groups and companies).

Ashwin Navin, the company’s president and co-founder, confirmed that it has noticed interference from Comcast, in addition to some Canadian Internet service providers.

“They’re using sophisticated technology to degrade service, which probably costs them a lot of money. It would be better to see them use that money to improve service,” Navin said, noting that BitTorrent and other peer-to-peer applications are a major reason consumers sign up for broadband.

BitTorrent Inc. announced Oct. 9 that it was teaming up with online video companies to use its technology to distribute legal content.

Other companies that rely on peer-to-peer technology, and could be affected if Comcast decides to expand the range of applications it filters, include Internet TV service Joost, eBay Inc.’s Skype video-conferencing program and movie download appliance Vudu. There is no sign that Comcast is hampering those services.

Comcast subscriber Robb Topolski, a former software quality engineer at Intel Corp., started noticing the interference when trying to upload with file-sharing programs Gnutella and eDonkey early this year.

In August, Topolski began to see reports on Internet forum DSLreports.com from other Comcast users with the same problem. He now believes that his home town of Hillsboro, Ore., was a test market for the technology that was later widely applied in other Comcast service areas.

Topolski agrees that Comcast has a right to manage its network and slow down traffic that affects other subscribers, but disapproves of their method.

“By Comcast not acknowledging that they do this at all, there’s no way to report any problems with it,” Topolski said.

Bandwidth Shaping - will the ISPs learn from the music industry’s failure

Tuesday, August 28th, 2007

So, we’ve all seen the various stories over the last year or so about ISPs blocking P2P and other bandwidth intensive services. I’ve been reading yet another one this morning and and it just occured to me: this is a parody of the music industry’s biggest mistake - trying to block the adoption and distribution of MP3 with law suits and DRM.

I’ve written previously about this here and here and here.

You can’t stop an advancing tide, forget it. If you try to prevent the natural progress you’ll lose, instead consumers will go elsewhere (either to your more open mined innovative competitors, or to new disruptive competitors who will enter the space).

The best option is to embrace the change AND work out how your business can make money from it. You either see it (and treat it) as a threat, or you see it (and treat it) as an opportunity. Its widely accepted that DRM is dying and that music companies must embrace new revenue models, same goes for ISPs and P2P.

The Venice Project will exhaust (current) ISP bandwidth limits

Tuesday, January 9th, 2007

If your ISP has a strict monthly limit on bandwidth usage, you could be forced to turn off the planned peer-to-peer TV streaming service from the founders of the Skype internet telephone service.

The beta video stream service, known as The Venice Project, is a bandwidth blockbuster, consuming an average 320MB of downloaded and 105MB of uploaded traffic for an hour’s worth of TV viewing. The service aims to distribute TV and other video content over the web instead of conventional terrestrial, satellite or cable channels.

The 105MB per hour upload rate is almost equivalent to 256Kbps and in documentation provided to beta testers, The Venice Project team warns that the service “will exhaust a 1GB cap in 10 hours”.

A typical video stream in TV quality consumes about 70GB per hour, a spokeswoman for The Venice Project confirmed. To lower users’ bandwidth requirements, The Venice Project is testing a new compressing technique but nevertheless points out that users will need to ensure that they have an upper limit on their monthly internet usage, according to the spokeswoman.

Many ISPs (Internet service providers) offer broadband connections with no time limitations but provide usage guidelines that seek to control users who regularly exceed agreed monthly data transmission volumes.

Because the service runs on a P2P (peer-to-peer) network, users both host and send TV programmes to other users in the automated system, adding to their usage.

The Venice Project is almost certain to worry the numerous network operators already concerned about their broadband pipes becoming plugged with a range of new video download services. A proliferation of these services could add fuel to the nation’s already overheated debate on network neutrality.

The project is the brainchild of Niklas Zennström and Janus Friis, the founders of the Kazaa P-to-P music exchange and Skype Voip (voice over internet protocol) service.

Intellipedia is intelligent move for spy agencies to embrace

Monday, December 4th, 2006

The Office of the Director of National Intelligence (DNI), led by John Negroponte, announced the formal launching of “Intellipedia” — a new online peer-to-peer collaboration system, allowing intelligence analysts and officials to coordinate information with each other on the federal government’s classified Intelink Web. Many of us are familiar with Intranets at our places of work. Intelink Web is the Intranet for DNI.

The Oct. 31 announcement is an important breakthrough.

Why?
It has been a very bad decade so far for America’s intelligence, law enforcement, and emergency response agencies.

Two national, heart-wrenching events have cast the spotlight on the U.S. Intelligence Community’s dire need for an agile, networking-based, deftly coordinating, and flat (a la Thomas Friedman) operational structure. Missteps prior to Sept. 11 and the Iraq War have been well-documented. Political leaders from both parties have called for a more collaborative intelligence culture. Consider these quotes from the 9/11 Commission’s July 2004 Public Statement:

“Our intelligence and law-enforcement agencies did not manage or share information, or effectively follow leads, to keep pace with a nimble enemy. …”

“The Intelligence Community needs a shift in mindset and organization, so that intelligence agencies operate under the principle of joint command, with information-sharing as the norm …”

“… ‘Need to share’ must replace ‘Need to know.’”

Earlier this year the U.S. Intelligence Community invited Jimmy Wales, founder of Wikipedia, to discuss the use of wiki technology for his juggernaut Web site. Wikipedia is a Web-based encyclopedia where anyone can create, edit and contribute to articles. According to a recent study conducted by Nature, Wikipedia fared well when compared to Encyclopedia Britannica regarding factual accuracy.

Charles Leadbeater, described by Accenture Consulting as one of the world’s top management thinkers, recently put Wikipedia’s application power in some perspective. In a paper posted on his Web site he wrote that in nearly a five-year span from 2001 to 2006, Wikipedia had gone from a collection of 10,000 articles to 1,000,000 articles. The Encyclopedia Britannica had 44 million words of text, whereas by early 2006, Wikipedia already had 250 million words of text.

Wikipedia demonstrates the effects of viral networking growth that can lead to a very positive social epidemic.

Leadbeater argues that Wikipedia’s processes takes peer-review and self-organized collaborative work to scale (i.e. maximizing the human capital relevant and available). He gives three reasons:

1. Participants are asked to ascribe to Wikipedia’s norms and values system — remaining neutral and leaving axes to grind at home;

2. The peer review system rarely stalls, having “evolved very delicately”;

3. Online activities are generally transparent, and hence accountable.

Wikipedia symbolizes an arrival of new social processes for communications and organization. If “wiki power” is married to the “social networking power” exhibited by mega- sites such as MySpace, YouTube and Facebook, we should see elevated productivity in a purpose-driven online space. Whether at the level of local civic group, nonprofit organization, federal agency or department, or even national movement, “wikis” combined with online networking should streamline communications, make group collaborations more effective and change the way we do our work.

Intellipedia is modeled after Wikipedia. Although there are concerns about Intellipedia’s security, most observers believe its potential long-term benefits outweigh risks to secrecy and security. According to news reports, intelligence officials say this new kind of networking and collaborative space could result in more accurate intelligence reports because the process should allow for more scrutiny. National Intelligence Estimates and Presidential Daily Briefings could soon be supported by “wiki” exchanges.

Will Intellipedia signal the transformation of the U.S. Intelligence Community? There is reason to be cautiously optimistic.

I had the good fortune to briefly discuss this development with Gregory Treverton, former vice chair of the National Intelligence Council and now a senior policy analyst at RAND Corporation. Treverton believes this is a “great idea and a good start for encouraging reform” in the U.S. Intelligence Community.

“Intellipedia is perfectly suited for intelligence work. The [wiki] system is conducive to frequent updating from multiple sources, and leaves a track record,” Treverton said.

In less than seven months since Intellipedia’s test launch, the content has grown to more than 28,000 pages, with 3,600 registered users in the online community. We are moving from an industrial society to a networking society, and our governmental bodies at all levels need to embrace the utility of the network effect. At the very least, we can applaud DNI’s efforts.

Paul Diperna, The Examiner. Paul DiPerna is founder and moderator of the Blau Exchange Project at www.blauexchange.org.

OA is here: http://www.examiner.com/a-430145~Paul_Diperna__Intellipedia_is_intelligent_move_for_spy_agencies_to_embrace.html