brightonSEO · September 2023
Googlebot Log Driven Design & AI Linking
Your crawl logs show what search engines request. Your search data shows what people look for. Bring the two together to decide which pages—and which connections between them—need attention.
Original presentation · 37 slides · PDF, 1.6 MB
Inside the talk
From log files to a useful action plan
See where Googlebot spends its time
Use server logs to understand crawl patterns and the responses your pages return.
Connect crawling to search demand
Bring log observations together with Search Console queries and clicks, organized by a useful URL taxonomy.
Turn the analysis into internal links
Compare page groups, identify relevant source and destination pages, and use search data to inform AI-assisted anchor text.
Make the work actionable
Use the combined view to prioritize page improvements, investigate server errors and review what changes over time.