Introducing Google for the Public Sector

(Cross-posted with the Google Public Policy Blog)

The 2008 elections demonstrated how technology can increase political participation, and now we're beginning to see the power of Web 2.0 come to government.

On the heels of last week's Gov 2.0 Summit in Washington, D.C., we're excited to launch Google for the Public Sector, a one-stop shop of tools and tips that local, state and federal government officials can use to help promote transparency and increase citizen participation.

The site helps government agencies:

• Make your website, and the information it offers, easier to find. For example, in less than 50 technical staff hours, Arizona's Government Information Technology Agency made hundreds of thousands of public records and other webpages "crawlable" to search engines and visible in Google search results.
• Visualize your information and tell your story in Google Earth & Maps to the hundreds of millions of people who use them. The State Department runs an interactive Google Map of Secretary Clinton's travels, which shows where she has been and includes photos and videos.
• Use the power of online video to engage millions of potential viewers and give constituents a voice. In the U.S. alone, the Senate, House of Representatives, White House, and federal government, among others, all have YouTube channels.
  

According to the Pew Internet and American Life Project, nearly four out of five American Internet users go online to find government information. Technology will help play a key role in making this information accessible, useful and transparent.

Posted by Ginny Hunt, Public Sector Project Manager

Growing open government with Transparency Camp West

(If you're interested in meeting the team of Googlers working to strengthen the public sector and civic engagement through technology, check out our Public Sector blog. -Ed.)

Organizing public sector information isn't easy, and companies like Google rely on the good work of open government advocates to access useful data. Last weekend more than 150 developers, NGOs, wonks, activists and government representatives from as far away as Russia and Israel gathered at our Mountain View campus for Transparency Camp West to discuss efforts to make governments more transparent and accessible to the public.

Sponsored by the Sunlight Foundation, a non-partisan organization founded in 2006, Transparency Camp allowed open government advocates to freely swap ideas about a wide range of topics: voting, journalism, public transit, healthcare, citizen engagement and more. The theme of openness also extended to the Sunlight Foundation's board meeting on Saturday. While most organizations hold their board meetings in private, the Sunlight Foundation opened their board meeting not only to staff, but also to members of the public.

The "un-conference" format let attendees decide session topics

At Google we're inspired by efforts to connect people to the political process, to useful public information and to their governments — and we're eager to participate. To hear more about the different kinds of bottom-up change proposed at Transparency Camp, head to the Google Open Source blog for a summary by Clay Johnson from the Sunlight Foundation.

This and previous photo courtesy of Heather Bussing

Posted by Chris DiBona, Open Source Programs Manager

Submit your ideas to change the face of broadband

Have an idea for how to expand high-speed Internet access across the United States? Here's your chance to have your voice heard.

Under the terms of the recent economic stimulus package, the Federal Communications Commission must deliver to Congress a National Broadband Plan by February 2010. Several weeks ago, we laid out Google's vision for how to make broadband Internet available and affordable for every American — and hundreds of others have already submitted comments of their own.

The FCC has called for "maximum civic engagement" in developing a broadband strategy, and we're hoping to help them to achieve just that.

We've teamed up with the New America Foundation to launch a Google Moderator page where you can submit and vote on ideas for what you think the Commission should include in its National Broadband Plan. Two weeks from now we'll take the most popular and most innovative ideas and submit them to the official record at the FCC on your behalf.

Google and the New America Foundation agree that public participation in this process is critical. Expanding access to broadband has the potential to transform communities across the country, spark economic growth, and restore American competitiveness. Now that the Commission has officially opened this proceeding, and with a new Chairman at the helm, we think it's time to give people the opportunity to learn about the issue and to weigh in with their thoughts. And as the process continues to unfold at the FCC, we'll keep you informed of additional ways to share your views and voice your ideas to the agency.

So do you have any good ideas? Submit them today on Google Moderator — and you just might help change the face of broadband in the United States.

Posted by Richard Whitt, Washington Telecom and Media Counsel

Media and citizens meet in the YouTube Reporters' Center

This is the first of a series of posts from YouTube's news and politics blog, Citizentube. -Ed.

YouTube is the biggest video news site on the Internet, and at no time in our site's history was that more apparent than in these last two weeks of the crisis unfolding in Iran. As hundreds of thousands of Iranian citizens took to the streets of Tehran to protest the national elections, the government kicked out foreign journalists, leaving citizens themselves as the only documentarians to the events unfolding there. We've been highlighting many of these videos and keeping track of the latest developments on our YouTube news and politics blog, Citizentube.

Though the circumstances in Iran are unique, this isn't the first time that citizens have played a crucial role in reporting on events around the world. Burmese citizens uploaded exclusive video footage to YouTube during the protests in Myanmar back in 2007; people in China's Sichuan province documented the devastating and historic 7.8-magnitude earthquake of 2008 in real-time; and eyewitnesses to the shooting of young Oscar Grant by Oakland police forces captured the event on their cell phone cameras and uploaded videos to YouTube for the world to see. Citizens are no longer merely bystanders to world events. Today, anyone can chronicle what they see and participate in the news-gathering process.

Though it's the phenomenon of citizen reporting that YouTube is probably best known for, we also have hundreds of news partners who upload thousands of videos straight to YouTube every day. You can see lots of these on our news page at youtube.com/news. Many of these organizations have used YouTube in unique ways, like asking the community to submit questions for government officials, providing a behind-the-scenes look at traveling with the Obama press corps and accepting video applications for a reporting assignment in West Africa. We believe the power of this new media landscape lies in the collaborative possibilities of amateurs and professionals working together.

And so today, we're launching a new resource on YouTube to help citizens learn more about how to report the news, straight from the experts. It's called the YouTube Reporters' Center, and it features some of the nation's top journalists sharing instructional videos with tips and advice for better reporting. Learn how to prepare for an interview; or how to be an investigative reporter from the legendary Washington Post journalist Bob Woodward; or how to report on a global humanitarian crisis from Nick Kristof of the New York Times. All of the videos are available on the YouTube Reporters' Center channel.

Posted by Olivia Ma, YouTube News and Politics

All for Good: Bringing search, scale and openness to community service

While many organizations are doing great work to enable community service locally, it's not simple to search across opportunities from a variety of places to find what's right for you. We have some experience finding relevant information from among many scattered sources, and when we learned that President Obama and the First Lady were making community service a top priority even before taking office, we thought we could help make a difference.

With our mission in mind, a group of "20%" engineers, designers, and program managers from Google and other tech companies began work on All for Good, a new service to help you find volunteer events in your community, and share those events with your friends.

All for Good provides a single search interface for volunteer activities across many major volunteering sites and organizations like United Way, VolunteerMatch, HandsOn Network and Reach Out and Read. By building on top of the amazing efforts of existing volunteer organizations like these, we hope to amplify their efforts.


And in the spirit of open data, All for Good has a data API that anyone can use to search the same data displayed on the All for Good site. All for Good was developed entirely using App Engine and Google Base, with the full code repository hosted on Google Code Hosting. We'll be inviting developers to contribute to the open source application soon, so stay tuned.

Just as releasing the Maps API led to an surge of independent and creative uses of geographic information, we've built All for Good as a platform to encourage innovation in volunteerism, as much as an end product in itself. We hope software developers will use the API or code to build their own volunteering applications, some even better than the All for Good site!

And if you want to volunteer your video-creating skills to make a difference, check out YouTube Video Volunteers, a new platform designed to make connections between non-profits with video needs and skilled video makers who can help broadcast their causes through video.

All for Good is a new kind of collaboration between the private, public and nonprofits sectors to build free and open technology to empower citizens. Similar to the Open Social Foundation, we helped create a new organization called Our Good Works to make sure that the API, the platform, and social innovation that they inspire are supported for the long term. The leadership includes Reid Hoffman, Chris DiBona, Arianna Huffington and Craig Newmark on the board, and the organization aims to build support volunteerism services like All for Good.

Today the First Lady is in San Francisco calling on Americans to improve our communities by rolling up our sleeves and putting our time and talent towards doing good. You can learn more at serve.gov, where we're proud to power search.

Posted by Paul Rademacher and Adam Sah, Engineering Tech Leads

Introducing Measurement Lab

When an Internet application doesn't work as expected or your connection seems flaky, how can you tell whether there is a problem caused by your broadband ISP, the application, your PC, or something else? It can be difficult for experts, let alone average Internet users, to address this sort of question today.

Last year we asked a small group of academics about ways to advance network research and provide users with tools to test their broadband connections. Today Google, the New America Foundation's Open Technology Institute, the PlanetLab Consortium, and academic researchers are taking the wraps off of Measurement Lab (M-Lab), an open platform that researchers can use to deploy Internet measurement tools.

Researchers are already developing tools that allow users to, among other things, measure the speed of their connection, run diagnostics, and attempt to discern if their ISP is blocking or throttling particular applications. These tools generate and send some data back-and-forth between the user's computer and a server elsewhere on the Internet. Unfortunately, researchers lack widely-distributed servers with ample connectivity. This poses a barrier to the accuracy and scalability of these tools. Researchers also have trouble sharing data with one another.

M-Lab aims to address these problems. Over the course of early 2009, Google will provide researchers with 36 servers in 12 locations in the U.S. and Europe. All data collected via M-Lab will be made publicly available for other researchers to build on. M-Lab is intended to be a truly community-based effort, and we welcome the support of other companies, institutions, researchers, and users that want to provide servers, tools, or other resources that can help the platform flourish.

Today, M-Lab is at the beginning of its development. To start, three tools running on servers near Google's headquarters are available to help users attempt to diagnose common problems that might impair their broadband speed, as well as determine whether BitTorrent is being blocked or throttled by their ISPs. These tools were created by the individual researchers who helped found M-Lab. By running these tools, users will get information about their connection and provide researchers with valuable aggregate data. Like M-Lab itself these tools are still in development, and they will only support a limited number of simultaneous users at this initial stage.

At Google, we care deeply about sustaining the Internet as an open platform for consumer choice and innovation. No matter your views on net neutrality and ISP network management practices, everyone can agree that Internet users deserve to be well-informed about what they're getting when they sign up for broadband, and good data is the bedrock of sound policy. Transparency has always been crucial to the success of the Internet, and, by advancing network research in this area, M-Lab aims to help sustain a healthy, innovative Internet.

You can learn more at the M-Lab website. If you're a researcher who'd like to deploy a tool, or a company or institution that is interested in providing technical resources, we invite you to get involved.

Posted by Vint Cerf, Chief Internet Evangelist, and Stephen Stuart, Principal Engineer

Net neutrality and the benefits of caching

(Cross-posted from the Google Public Policy Blog)

One of the first posts I wrote for this blog last summer tried to define what we at Google mean when we talk about the concept of net neutrality.

Broadband providers -- the on-ramps to the Internet -- should not be allowed to prioritize traffic based on the source, ownership or destination of the content. As I noted in that post, broadband providers should have the flexibility to employ network upgrades, such as edge caching. However, they shouldn't be able to leverage their unilateral control over consumers' broadband connections to hamper user choice, competition, and innovation. Our commitment to that principle of net neutrality remains as strong as ever.

Some critics have questioned whether improving Web performance through edge caching -- temporary storage of frequently accessed data on servers that are located close to end users -- violates the concept of network neutrality. As I said last summer, this myth -- which unfortunately underlies a confused story in Monday's Wall Street Journal -- is based on a misunderstanding of the way in which the open Internet works.

Edge caching is a common practice used by ISPs and application and content providers in order to improve the end user experience. Companies like Akamai, Limelight, and Amazon's Cloudfront provide local caching services, and broadband providers typically utilize caching as part of what are known as content distribution networks (CDNs). Google and many other Internet companies also deploy servers of their own around the world.

By bringing YouTube videos and other content physically closer to end users, site operators can improve page load times for videos and Web pages. In addition, these solutions help broadband providers by minimizing the need to send traffic outside of their networks and reducing congestion on the Internet's backbones. In fact, caching represents one type of innovative network practice encouraged by the open Internet.

Google has offered to "colocate" caching servers within broadband providers' own facilities; this reduces the provider's bandwidth costs since the same video wouldn't have to be transmitted multiple times. We've always said that broadband providers can engage in activities like colocation and caching, so long as they do so on a non-discriminatory basis.

All of Google's colocation agreements with ISPs -- which we've done through projects called OpenEdge and Google Global Cache -- are non-exclusive, meaning any other entity could employ similar arrangements. Also, none of them require (or encourage) that Google traffic be treated with higher priority than other traffic. In contrast, if broadband providers were to leverage their unilateral control over consumers' connections and offer colocation or caching services in an anti-competitive fashion, that would threaten the open Internet and the innovation it enables.

Despite the hyperbolic tone and confused claims in Monday's Journal story, I want to be perfectly clear about one thing: Google remains strongly committed to the principle of net neutrality, and we will continue to work with policymakers in the years ahead to keep the Internet free and open.

P.S.: The Journal story also quoted me as characterizing President-elect Obama's net neutrality policies as "much less specific than they were before." For what it's worth, I don't recall making such a comment, and it seems especially odd given that President-elect Obama's supportive stance on network neutrality hasn't changed at all.

Update: Larry Lessig, Save the Internet, Public Knowledge, David Isenberg, Wired and others all found fault with today's piece too.

Posted by Richard Whitt, Washington Telecom and Media Counsel

Safety, education, and empowerment on YouTube

(Cross-posted from the YouTube Blog)

We've always been committed to providing you the tools to have the best possible YouTube experience. Educating parents, teens, and families on how to stay safe on our site is a critical part of that commitment, so we can't think of a more appropriate place to introduce our new Abuse and Safety Center than at the Family Online Safety Institute (FOSI) conference in Washington, D.C., today.


The center features straightforward safety tips and multimedia resources from experts and prominent safety organizations. We are empowering people with the information and tools they need to help them deal with issues like cyberbullying, online harassment, and hateful content.



The new center also makes it easier for you to find our Help and Safety Tool, which lets you report concerns to us and gives you granular control over your channel, like the option of blocking comments from specific users or disabling the video comments feature on specific videos.

The Abuse and Safety Center is easy to find. Just look at the bottom of any YouTube page and click on the link titled "Abuse and Safety Center." From phishing scams to just learning what it means to be a good YouTube citizen, you'll find the information you need.

Finally, check out FOSI's meeting page for more information about our presence at the conference, where Shantal Rands from Google's legal team will receive a FOSI Award for Outstanding Achievement in advancing the goal of a safer Internet. Plus, Andrew McLaughlin, Google's Director of Global Policy & Government Affairs, is speaking about "Protecting Kids and Free Speech Online," and YouTube's Policy Analyst Micah Schaffer will address online safety in social media.

We'll continue to add new information and features to the center, so check back often.

Posted by The YouTube Team

How we help track flu trends

This post is the latest in an ongoing series about how we harness the data we collect to improve our products and services for our users. - Ed.

Google search isn't just about looking up football scores from last weekend or finding a great hotel for your next vacation. It can also be used for the public good. Yesterday, we announced Google Flu Trends, which uses aggregated search data in an effort to confront the challenge of influenza outbreaks.

By taking Google Trends — where you can see snapshots of what's on the public's collective mind — and applying the tool to a public health problem, our engineers found that there was a correlation between flu-related queries and the actual flu. They created a model for near real-time estimates about outbreaks, in the hopes that both health care professionals and the general public would use this tool to better prepare for flu season.

Since we launched yesterday, the response from the medical community has been positive. "The earlier the warning, the earlier prevention and control measures can be put in place," said Dr. Lyn Finelli of the influenza division at the Centers for Disease Control and Prevention, to The New York Times. "[T]his could prevent cases of influenza." You can check out the tool for yourself.

We couldn't have built this flu detection system without analyzing historical patterns. Because flu season is different every year, just a few months of data wouldn't have done the trick. For example, the 2003-2004 flu season was unusually severe in many regions. The data from that season was especially robust and allowed us to discover a more accurate, reliable set of flu-related terms. To learn more about how we built the system, see this page on how Flu Trends works.

Because we're committed to protecting your privacy, we made sure that the searches that we analyze for Google Flu Trends are not drawn from personally-identifiable search histories but rather from an aggregated set of hundreds of billions of searches.

In order to provide a rough geographic breakdown of potential flu outbreaks, we use IP address information from our server logs to make a best guess about where queries originate. To protect your privacy, we anonymize those IP addresses at nine months. And we don't provide this aggregated, anonymized data to third parties. For more information about the privacy protections for Flu Trends check out our FAQs and privacy policy.

This is just the first launch in what we hope will be several public service applications of Google Trends in the future. And as we continue to think of ways to use aggregated and anonymized search data in helpful ways, we're also committed to safeguarding our users' privacy.

Posted by Pablo Chavez, Senior Policy Counsel

A vote for broadband in the "white spaces"

All eyes are on the presidential election today, but another important vote just took place at the Federal Communications Commission. By a vote of 5-0, the FCC formally agreed to open up the "white spaces" spectrum -- the unused airwaves between broadcast TV channels -- for wireless broadband service for the public. This is a clear victory for Internet users and anyone who wants good wireless communications.

The FCC has been looking at this issue carefully for the last six years. Google has worked hard on this matter with other tech companies and public interest groups because we think that this spectrum will help put better and faster Internet connections in the hands of the public. We also look forward to working with the FCC to finalize the method used to compute power levels of empty channels adjacent to TV channels (we have a number of public filings before the commission in this area and it is a vital issue in urban areas).

I've always thought that there are a lot of really incredible things that engineers and entrepreneurs can do with this spectrum. We will soon have "Wi-Fi on steroids," since these spectrum signals have much longer range than today's Wi-Fi technology and broadband access can be spread using fewer base stations resulting in better coverage at lower cost. And it is wonderful that the FCC has adopted the same successful unlicensed model used for Wi-Fi, which has resulted in a projected 1 billion Wi-Fi chips being produced this year. Now that the FCC has set the rules, I'm sure that we'll see similar growth in products to take advantage of this spectrum.

As an engineer, I was also really gratified to see that the FCC decided to put science over politics. For years the broadcasting lobby and others have tried to spread fear and confusion about this technology, rather than allow the FCC's engineers to simply do their work.

Finally, I want to applaud and thank FCC Chairman Kevin Martin, the other commissioners, and the FCC Office of Engineering and Technology for their leadership in advancing this important issue. And, thanks to the more than 20,000 of you who took a stand on this issue through our Free the Airwaves campaign, the FCC heard a clear message from consumers: these airwaves can bring wireless Internet to everyone everywhere.

Posted by Larry Page, Co-Founder and President of Products

New steps to protect free expression and privacy around the world

In a world where governments all too often censor what their citizens can see and do on the Internet, Google has from the start promoted global free expression and taken the lead in being transparent with our users. We've pressed governments around the world to stop limiting free speech and made it possible for dissidents, bloggers and others to have their voices heard.

As part of those ongoing efforts to promote free expression and protect our users' privacy, today we're announcing Google's participation as a founding company member of a new program called the Global Network Initiative.

This initiative is the result of two years of discussions with other leading technology companies, human rights organizations, socially responsible investors and academic institutions. Thanks to hard work and cooperation from all parties, the Initiative sets the kinds of standards and practices that all companies and groups should use when governments threaten internationally recognized rights to free expression and privacy.

The Global Network Initiative also offers an important commitment from all parties to take action together to promote free expression and protect privacy in the use of all information and communication technologies. We know that common action by these diverse groups is more likely to bring about change in government policies than the efforts of any one company or group acting alone.

Companies that join the Initiative commit to putting into effect procedures that will protect their users by:

• Evaluating against international standards government requests to censor content or access user information
• Providing greater transparency
• Assessing human rights risks when entering new markets or introducing new products
• Instituting employee training and oversight programs

These are things that Google does now, but joining the Initiative will help us refine our methods and maintain our leadership position. Down the road companies will be assessed on how they're doing in implementing the principles and the Initiative will report those results.

This Initiative is by no means a silver bullet or the last word, but it does represent a concrete step toward promoting freedom of expression and protecting users' privacy in the 60th anniversary year of the Universal Declaration of Human Rights. Now we're actively recruiting more companies and groups to join the Initiative and advance these critical human rights around the world.

Posted by Andrew McLaughlin, Director of Public Policy and Government Affairs

Our position on California's No on 8 campaign

As an Internet company, Google is an active participant in policy debates surrounding information access, technology and energy. Because our company has a great diversity of people and opinions -- Democrats and Republicans, conservatives and liberals, all religions and no religion, straight and gay -- we do not generally take a position on issues outside of our field, especially not social issues. So when Proposition 8 appeared on the California ballot, it was an unlikely question for Google to take an official company position on.

However, while there are many objections to this proposition -- further government encroachment on personal lives, ambiguously written text -- it is the chilling and discriminatory effect of the proposition on many of our employees that brings Google to publicly oppose Proposition 8. While we respect the strongly-held beliefs that people have on both sides of this argument, we see this fundamentally as an issue of equality. We hope that California voters will vote no on Proposition 8 -- we should not eliminate anyone's fundamental rights, whatever their sexuality, to marry the person they love.

Posted by Sergey Brin, Co-founder & President, Technology