UrlFetchApp.fetch - missing code of webpage. How to get full code?

1
votes

I'm trying to get data from this webpage:

http://www.gymboree.com/shop/dept_item.jsp?PRODUCT%3C%3Eprd_id=845524446027540&FOLDER%3C%3Efolder_id=2534374305278637&ASSORTMENT%3C%3East_id=1408474395917465&bmUID=1363035275064&productSizeSelected=0&fit_type=

by UrlFetchApp.fetch(url).getContentText() but I don't get all the data from the page:

UrlFetchApp.fetch(url).getContentText() give me: 

<ul id=""size-options-ul"" class=""size-options""> <!-- AJAX DATA -->

but within this directory have an extra code (I click in Google Chrome, right-click on the page, then Inspect Element. Chrome gives me all the code of this page)

<ul id="size-options-ul" class="size-options"><li id="1689949376460861_0" title="0-3 mos"><a href="javascript:DoSmth()" title="0-3 mos"><span>0-3 mos</span></a></li><li id="1689949376460862_1" title="3-6 mos" class=""><a href="javascript:DoSmth()" title="3-6 mos"><span>3-6 mos</span></a></li><li id="1689949376460864_2" title="6-12 mos" class="selected"><a href="javascript:DoSmth()" title="6-12 mos"><span>6-12 mos</span></a></li><li id="1689949376460865_3" title="12-18 mos" class=""><a href="javascript:DoSmth()" title="12-18 mos"><span>12-18 mos</span></a></li><li id="1689949376460866_4" title="18-24 mos"><a href="javascript:DoSmth()" title="18-24 mos"><span>18-24 mos</span></a></li></ul>

How can i get full code? maybe some arguments of UrlFetch can do it? I think this page dynamically generated via Javascript... but somehow Chrome takes all the data from the page and the script maybe possible.

Thanks! Ivan.

1
javascriptgoogle-apps-script

1 Answers

0
votes

Yes, Chrome Interprets the Javascript after the page loads and inserts the results in the DOM (so you can view the current state in Inspect Element). You need to use tools that can "interpret" the javascript See these links