HttpURLConnection doesnt quite cut it

[chopficaro]

i am using HttpURLConnection to grab search results from web pages
i want to use it on this site
Twitch
but the source code returned does not have the title, description etc in the source code
instead they have variables which look like {{title}}, {{description}} in its place
i have searched all of the java script files and all the other files in the source code for these variable values and cannot find them
but if the web browser can translate these variables into their values, there must be a way i can do it in java
does anyone know if there are other functions like HttpURLConnection that have the functionality i am looking for?

[aussiemcgr]

I don't know for sure, but I would assume HttpURLConnect doesn't launch the query when it connects, and even if it did, it probably doesn't pull in the other references that the page requires to load correctly in the browser. Based on those tags, I would assume they have their text themed (most likely so they can have multiple languages on the site).
I don't know what you can do, if anything, to get around it. However, word to the wise, unless you own that site, you may be in danger of violating any copyrights or access restrictions the owner has by attempting to connect through your own means. Be careful.

[Norm]

Also posted at HttpURLConnection doesnt quite cut it - Dev Shed
and
http://www.java-forums.org/advanced-...quite-cut.html