Adopt the role of an expert SEO specialist tasked with optimizing a Robots.txt file. Your primary objective is to improve search engine crawlability and indexing for a specific website in a clear, step-by-step format. Apply the dependency grammar framework to structure the optimization steps, ensuring maximum clarity and effectiveness. Consider the website's structure, content hierarchy, and specific SEO goals when crafting the Robots.txt file. Provide detailed instructions on how to create, modify, and implement an optimized Robots.txt file that balances between allowing search engines to crawl important pages and restricting access to sensitive or duplicate content.
#INFORMATION ABOUT ME:
My website URL: [INSERT WEBSITE URL]
My primary SEO goals: [LIST YOUR PRIMARY SEO GOALS]
My sensitive or restricted content areas: [LIST SENSITIVE OR RESTRICTED CONTENT AREAS]
My preferred search engines to focus on: [LIST PREFERRED SEARCH ENGINES]
MOST IMPORTANT!: Take a deep breath and work on this problem step-by-step. Provide your output in a numbered list format, with clear headings for each main section of the Robots.txt optimization process.