从网页（Web爬虫）中提取所有链接(Extract all links from Web page(Web crawler))

编程入门行业动态更新时间:2024-10-21 06:01:49

我想开发一个应用程序我给它的特定网站的Urls，它从该网页中提取所有链接。这里我想把它的Url发给我的应用程序的网页是由Asp.net开发的，包含一个Search buttom，一个用于显示结果的GridView和一个DataPager，GridView包含用于绑定搜索结果的HyperLinkField控件。

当我单击目标页面的搜索按钮时，页面将被回发并通过GridView显示搜索结果而不更改页面的URL。

例如，如果搜索结果有500条记录而datapager.PageSize = 10则我们有50页。

现在我想知道是否可以使用我的应用程序一次性提取绑定到Gridview的所有500个链接，除了打开所有50个页面并使用我的应用逐个提取任何页面？

谢谢。

I Want to develope an app I give Urls of specific website to it,and it extract all links from that Web page. Here the web page that I want to give it's Url to my app,is developed by Asp.net and contains a Search buttom ,a GridView for showing the result and a DataPager ,and GridView contains HyperLinkField control for binding to the search's result.

When I click the Search buttom of the goal page the page is postbacked and show search result by GridView without changing the url of the page.

For example if search result have 500 records and datapager.PageSize=10 then we have 50 pages.

Now I want to know is it possible to extract all 500 links that binded to Gridview at once with my app,except opening all 50 pages and extract any page one by one with my app?

Thanks.