How to extract a field from xpath which is not present in an element tag?

Question

<div class="info">
    <span class="label">Establishment year</span>
    "2008"
</div>

I want to extract 2008 by using xpath but the expression just selects the establishment text.

driver.find_element_by_xpath("//*[text()='Establishment year']")

@LucasWieloch I only want to extract 2008 and not the text 'Establishment year' — Prakhar T, Jul 17 '19 at 10:14
@PrakharT yes, and 2008 is inside the div's text node, which means that it is present in an element tag. How could it not be present in an element tag? Anyways, the xpath you want is something like this `//div[@class='info']/text()`. Try it — Lucas Wieloch, Jul 17 '19 at 10:20
but the class 'info' is not unique.The text 'establishment year' is the unique field from where I can reach this node. — Prakhar T, Jul 17 '19 at 10:22

score 1 · Accepted Answer · answered Jul 17 '19 at 10:06

1

As the text 2008 is within a text node to extract the text 2008 you can use the following solution:

print(driver.execute_script('return arguments[0].lastChild.textContent;', WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//div[@class='info']/span[@class='label' and text()='Establishment year']/..")))).strip())

answered Jul 17 '19 at 10:06

DebanjanB

118,661
30
168
217

I only want to extract 2008 and not the text 'Establishment year' – Prakhar T Jul 17 '19 at 10:15
@PrakharT What is the output you are getting once you incorporate this line of code? – DebanjanB Jul 17 '19 at 10:19
can you please share some tutorial for driver.execute_script function? – Prakhar T Jul 17 '19 at 10:41
@PrakharT Here a few good discussions to start with to understand `execute_script ()` function: [this](https://stackoverflow.com/questions/52689880/what-is-javascriptexecutor-in-selenium/52698089#52698089) and [this](https://stackoverflow.com/questions/49871432/what-does-arguments0-and-arguments1-mean-when-using-executescript-method-fro/49873090#49873090) – DebanjanB Jul 18 '19 at 06:39

score 1 · Answer 2 · answered Jul 17 '19 at 10:19

Unfortunately WebDriver does not allow find_element function result to be a Text Node so you will have to go for execute_script function like:

driver.execute_script(
"return  document.evaluate(\"//div[@class='info']/node()[3]\", document, null, XPathResult.STRING_TYPE, null).stringValue;")

Demo:

More information:

How to extract a field from xpath which is not present in an element tag?

2 Answers2