Google’s Year in Custom Search

Google's Custom Search turned three in 2009, and it had arguably its biggest year to date. The technology is powering "many tens of millions" of queries a day on millions of sites, according to the company.

As many others are doing, Google is reminiscing about the year that is almost over, and reflecting upon some of its accomplishments. The Custom Search Team specifically is reflecting on some of its highlights for 3009.

Google lists the following as key developments for the year in custom search:

• integration with several hosters to bring Custom Search to your doorstep
• enabled support for rich snippets, giving you more control over presentation of results
• it's now easier for you to promote specific content to the top of your search results
• we deployed contextual search within Blogger, Google Sites and Wikipedia
• automatic transliteration is now integrated into the search box
• improved results rendering flexibility with the Custom Search Element
• plug-n-play with themes for enhanced customizability of results look and feel
• added support for structured metadata and the ability to restrict results by specific attributes
• we got you ready for the growing population of users searching your websites with mobile devices, such as Android phones, iPhone, iPod Touch, Palm Pre, etc.

Google promises additional metadata support in the new year, with more results customization and other features for Custom Search. With that in mind, it may be a good time to give Google you feedback, if you are a user of Custom Search. They're openly requesting it.
 

Have You Read This?

> Google Does Some New Things with Custom Search

> Google Launches Custom Search For Smartphones

> AdSense For Search, Custom Search Come Together

Ensuring Your Site is Indexed in Google’s Mobile Search

In this day and age, you pretty much can't ignore mobile users. The rate at which consumers are accessing the web via mobile devices is growing rapidly, largely thanks to the increasing popularity and production of smartphones.

Just having a mobile site isn't even enough. Sure, it's a great start, but you have to start thinking about a mobile site just as you would a regular site. Can people find it? Just because you have a good ranking in Google does not mean that your mobile site has a good ranking in Google's mobile search engine, or is even indexed at all.

Google recently shared a few important tips for making sure your mobile site is being indexed in Google's Mobile Search.

1. Create a mobile sitemap and submit it to Google so Google knows it exists. This can be done using Google Webmaster Tools, just like with a regular sitemap.

2. To make sure Googlebot-Mobile can access your site, allow any User-agent to access it.

"You should also be aware that Google may change its User-agent information at any time without notice, so it is not recommended that you check if the User-agent exactly matches 'Googlebot-Mobile' (which is the string used at present)," says Jun Mukai, a software engineer on Google's mobile search team. "Instead, check whether the User-agent header contains the string 'Googlebot-Mobile'. You can also use DNS Lookups to verify Googlebot."

3. Check that your mobile-friendly URLs' DTD (Doc Type Definition) declaration is in an appropriate mobile format such as XHTML Mobile or Compact HTML.

If you run both a regular site and a mobile version of it, there is a possibility that the wrong version will show up in the wrong search results. There are ways you can prevent this.

"When a mobile user or crawler (like Googlebot-Mobile) accesses the desktop version of a URL, you can redirect them to the corresponding mobile version of the same page," explains Mukai. "Google notices the relationship between the two versions of the URL and displays the standard version for searches from desktops and the mobile version for mobile searches."

If you do use a redirect, you should make sure content on the corresponding URL matches as closely as possible, because Google finds sites that abuse the practice in order to try and boost their rankings. Google says this should be avoided at all costs, so you can probably expect to be penalized for such an action.

Another way you can make sure a user is pointed to the right version of your site is simply to provide a link. In fact, that is what Google itself does. If you access the mobile version of Google, you will find a link to the desktop version.

Another way still, is to switch content based on the User-agent, so mobile users automatically see the mobile version and desktop users see the desktop version, even though both are accessing the same URL.

Google warns, however, that if you use this method, there is a chance that if you fail to configure your site correctly, it could be mistaken for cloaking, which you can be penalized for.

"To remain within our guidelines, you should serve the same content to Googlebot as a typical desktop user would see, and the same content to Googlebot-Mobile as you would to the browser on a typical mobile device," says Mukai. "It's fine if the contents for Googlebot are different from the one for Googlebot-Mobile."

Have you taken the necessary steps to ensure you are being indexed in Google's mobile search engine? Have you been left out due to cloaking-related confusion? Discuss here.

Have You Read This?

> Google Launches Custom Search For Smartphones

> Google Gives Mobile Searchers More Options

> Google Revamps Mobile Local Search Experience

Yahoo Pushes Out the New Search Design

Along with Yahoo's big new "Y!ou" campaign, the company has begun rolling out the new Yahoo Search. They unveiled the new design last month, which compliments the recently launched redesigns of the Yahoo Home Page, Yahoo Mail, and Yahoo Messenger.

"The new page is designed to help you easily find and explore the things that matter most to you. The Yahoo! Search team is delighted to demonstrate our commitment to innovate in search technology and deliver an amazing user experience," says Larry Cornett, Vice President, Consumer Products, Yahoo Search.

Yahoo names the following as key highlights of the new Yahoo Search:

Intelligent Search Results – Allows you to explore results from key sites and narrow results using different types of SearchMonkey structured data. Over the past few months, even more enhanced results for product, local, entertainment, reference, social, and tech sites have been displayed automatically. With the new search page design, we have made it easier to see these riche results from an increasing number of sites.

Feature-Rich Experience – Provides quick access to search features that make people’s online lives safer and easier, including Search Scan/SafeSearch (which helps protect you from viruses, spyware, and spam while you search) and Search Pad. Now it will be even easier to return to the research documents you have created while searching.

Search Assist Expansion – With the new design, our powerful query assistance is still available directly below the search box, but we’ve also incorporated it into the left-hand column for quick access lower on the page, even when the Search Assist layer is hidden. You can use this column to easily explore and discover concepts related to your query. We have added Search Assist to the search box on every Yahoo! page in the U.S. with the launch of a new universal header.

Along with the change to Yahoo Search itself, comes a "revamping" of Yahoo's image search and video search results pages. In the left-hand columns on these, you wil get links to related categories.

"Rather than building this new experience on top of our existing front-end technology, our talented engineering and design teams rebuilt much of the foundational markup/CSS/JavaScript for the SRP design and core functionality completely from scratch," says Cornett. "This allowed us to get rid of old cruft and take advantage of quite a few new techniques and best practices, reducing core page weight and render complexity in the process."

Yahoo says the new Yahoo Search includes improved page load time, improved perceived load time, and inline data URI images. It's now available in the US, the UK, France, Spain, Mexico, and India.

Get Your Videos Indexed in Google Results

Google wants webmasters who offer video content to be able to get their videos displayed in search results more easily. The company has announced that that it now supports Facebook Share and Yahoo SearchMonkey RDFa, which are both markup formats that allow webmasters to specify information that is important to video indexing.

"While we've become smarter at discovering this information on our own, we'd certainly appreciate some hints directly from webmasters," says Google's Michael Cohen, Product Manager for the Video Search Team.

The formats cater to simple things like titles and descriptions within the HTML of a video page. Google by the way also suggests that webmasters make their markup on video pages appear in the HTML without the execution of JavaScript or Flash.

On top of supporting the aforementioned formats, Google has also kicked off a series of Webmaster Central Blog posts, which are aimed at giving tips to get your videos indexed. One subject they have already discussed is the submission of video sitemaps.

Webmasters can submit their video sitemaps to Google via Webmaster Tools. The video sitemap uses the Sitemap protocol, but it also has additional video-specific tags. The details on how to create a video sitemap are explained here.

Keep an eye the Webmaster Central Blog for further tips in the near future. You can see what Facebook Share and Yahoo SearchMonkey RDFa look like here.