iEntry 10th Anniversary RSS Feedback
WebProNews Home About Feedback RSS

Posts Tagged ‘robots.txt’

SES: High Rankings CEO and Founder Jill Whalen on Duplicate Content and Tags

Search engine marketing is very broad, and includes many different issues. At the SES conference in New York, Webpronews caught up with Jill Whalen, the CEO and founder of High Rankings, and talked with her about a few of these issues. One of the issues concerning SEO is duplicate content. As Whalen explains, many people [...]

SES: Yahoo Search Product Manager Priyank Garg

Robots.txt serves as a tool to guide obedient search engine spiders to the content a webmaster wants indexed. It also blocks those spiders from reaching content as the webmaster desires.
It’s a relatively simple concept to implement, and it began out of a cooperative discussion between search engines over a decade ago. Although simplistic as [...]