Welcome to Geeks to Go - Register now for FREE

Need help with your computer or device? Want to learn new tech skills? You're in the right place!
Geeks to Go is a friendly community of tech experts who can solve any problem you have. Just create a free account and post your question. Our volunteers will reply quickly and guide you through the steps. Don't let tech troubles stop you. Join Geeks to Go now and get the support you need!

Javascript Disabled Detected

You currently have javascript disabled. Several functions may not work. Please re-enable javascript to access full functionality.

Can You Surf An Entire Website Stored In The Wayback Machine Or Just T

Started by Shah Saeed , Jan 19 2016 10:40 AM

Please log in to reply

#1
Shah Saeed

Posted 19 January 2016 - 10:40 AM

Member

Member
20 posts

I Have Tried Using Wayback Machine To Browse Old Websites Just For Fun.But The Thing Is That If I Click Search A Term on Youtube Or Google This Message Comes Up

Page cannot be crawled or displayed due to robots.txt.

Is There Any Way To Search An Entire Website On The Wayback Machine Or Does It Only Display Snapshots?????

Also Does robots.txt Completely Remove A Link Or Page Or Does It Just Make It Inaccessible????????And Is There Anyway To Bypass It?????

Edited by Shah Saeed, 19 January 2016 - 10:44 AM.