11
votes

I'm looking for a tool or service that can spider a web domain with a large number of pages, create a sitemap, and then visualize that map in a way that will help me see, understand and group content (I'm new to the site) Something like a tree-view or other standard Site Map visualizations would be great. I am yet unable to find a tool that does this (I've found plenty of things to spider the site and create an xml file, nothing to visualize it)

Thanks!

3
Just out of curiosity, how large is large? 100 pages? 1000? 10000? more? - juniper-

3 Answers

2
votes

The software Gephi and one of its plugins provides exactly the function that you need.

1
votes

For visualization you can check D3.js

For example Force-Directed Graph

0
votes

Visualize website structure you can with Site Visualizer software.

Download and install it, then create new project and click Start toolbutton. After the site will be crawled, open Visual Sitemap tab and click Draw button. Visual map of the site will be created as a set of pages (rectangles) and links (arrows). Click on a rectangle in order to highlight all outbound links of the page. You can also save this visualization to an image file: png, jpg, bmp, etc.:

site map visualization