Lovely Tools

HTML Robots.txt Generator


HTML Robots.txt Generator | Free Online Tool

Generate a valid robots.txt file to allow or disallow web crawlers from indexing specific directories.

HTML Robots.txt Generator

Configuration
Crawler Rules
Discovery
Live Preview

        
                

            

            
            
            

                

                    Generated Code