How read content of a span tag using HtmlAgilityPack?

Question

I'm using HtmlAgilityPack to scrap data from a link(site). There are many p tags, header and span tags in a site. I need to scrap data from a particular span tag.

var webGet = new HtmlWeb();
var document = webGet.Load(URL);
foreach (HtmlNode node in document.DocumentNode.SelectNodes("\\span"))
{
      string strData = node.InnerText.Trim();
}

I had tried by using keyword on parent tag which was not working for all kind of URLs.

Please help me to fix it.

Answer 1

What is the error?

You can start by fixing this:

foreach (HtmlNode node in document.DocumentNode.SelectNodes("\\span"))

it should be:

foreach (HtmlNode node in document.DocumentNode.SelectNodes("//span"))

---

But I want exact data. For example, there are too many span tags in source as <span>abc</span>, <span>def</span>, <span>pqr</span>, <span>xyz</span>. I want the result as "pqr". Is there any option to get it by count of particular tag or by index?

If you want to get, for example, the third span tag from the root:

 doc.DocumentNode.SelectSingleNode("//span[3]")

If you want to get the node containing the text "pqr":

doc.DocumentNode.SelectSingleNode("//span[contains(text(),'pqr')]");

You can use SelectNodes for the latter to get all span tags containing "pqr" in the text.