# Domain:[www.ancestry.com]
#
# This file should reside in the root directory ancestry.XX/robots.txt
# 
# Tells Scanning Robots Where They Are And Are Not Welcome
# User-agent: can also specify by name; "*" is for all bots
# Disallow: disallow if directive matches first part of requested path
#
#

User-agent: *
Disallow: /search/searchwidget.aspx
Disallow: /browse/bookview.aspx
Disallow: /Browse/BookView.aspx
Disallow: /Browse/bookview.aspx
Disallow: /Browse/print_b.aspx
Disallow: /browse/print_b.aspx
Disallow: /browse/print_u.aspx
Disallow: /Browse/print_u.aspx
Disallow: /browse/save_u.aspx
Disallow: /Browse/save_u.aspx
Disallow: /browse/view.aspx
Disallow: /Browse/view.aspx
Disallow: /iexec?htx=View
Disallow: /iexec?htx=view
Disallow: /iexec/?htx=View
Disallow: /iexec/?htx=view
Disallow: /iexec/Default.aspx?htx=view
Disallow: /iexec/Default.aspx?htx=View
Disallow: /promo/*
Disallow: /security/*
Disallow: /cs/standards/*
Disallow: /HomeRedirect.aspx*
Disallow: /academy/admin*
Disallow: /academy/admin/*

## Below disallows are to accommodate user requests to remove a name from Google/Bing search results.  The intent is to suppress known URLs that include the name.

Disallow: /genealogy/records/tara-milutis_161886488

## Proximic, comScore's bot was hitting some Acom iframe functionality on Newspapers hard

User-agent: proximic
Disallow: /savetoancestry*

Sitemap: https://www.ancestry.com/family-trees/sitemap.xml
Sitemap: https://www.ancestry.com/sitemap.xml
Sitemap: https://cdn-api.ooyala.com/syndication/google?k=XWIQBcHj3R

## Robots.txt additions - formerly on secure subdomain. Added for post migration 
## and subdomain consolidation.

User-agent: sogou spider
Disallow: /secure/

User-agent: *
Allow: /secure/Subscribe/Gift
Disallow: /secure/register/*
Disallow: /secure/security/forgotpassword.aspx
Disallow: /secure/register/guestregistration.aspx
Disallow: /secure/subscribe/controls/thawte.html

##Additional exclusion for one-off page that should not be served or displayed in ##search

User-agent: *
Disallow: /secure/FamilySearch/ReviewNgTemplate

##Robots.txt additions - trees migration

User-agent: *
Disallow: /family-tree/Frozone/AJAX/Command.ashx
Disallow: /family-tree/pt/person.aspx
Disallow: /family-tree/owt/altparent.aspx
Disallow: /family-tree/*/mergefamilyupdate*

##Robots.txt exclusion for dna

User-agent: *
Disallow: /dna/relatedness

##Robots.txt updates for Merlin migration
User-agent: *
Disallow: /wiz

## Below disallows are to accommodate user requests to remove a name from Google/Bing search results.  The intent is to suppress known URLs that include the name.##
 
User-agent: *
Disallow: /search/categories/34/?name=_HOTMER&name_x=1_1*
Disallow: /search/categories/bmd_marriage/?name=_Bissainthe*
Disallow: /search/categories/38/?name=Amalia_Passacos*
Disallow: /search/categories/usfedcen/?name=Amalia_Passacos*
Disallow: /search/categories/39/?name=Amalia_Passacos*
Disallow: /search/categories/35/?name=Amalia_Passacos*
Disallow: /search/categories/34/?name=Amalia_Passacos*
Disallow: /search/categories/bmd_birth/?name=Amalia_Passacos*
Disallow: /search/categories/34/?name=Amalia_Passacos&_phsrc=ChY1&_phstart=successSource*
Disallow: /search/?name=Amalia_Passacos*