Java program for downloading contents from the web

Hi there,

I need to download some content from the internet with Java, for example the first three links generated by Yahoo! or any other search engine of my choice.

Is there some class in Java that can help me with this function? Or maybe some other approach?

Thanks for your help!

Hello alley,

When you say you want to download the first 3 links generated by Yahoo! Do you mean just the URLs on the content of their web pages?

Take a look at our Tips & Tutorials forum, there are lots of code examples there.

I think this will help you:

http://www.javaprogrammingforums.com...bsite-url.html

You can point it to Yahoo! and then grab the URLs from the source.

Hi JavaPF,

I mean the content of the webpages.

Thanks for the links, I will check them out!

:-bd

Quote:

---

Originally Posted by alley

Hi JavaPF,

I mean the content of the webpages.

Thanks for the links, I will check them out!

:-bd

---

Including the website images and everything else or just the source code?

I just read your post

Quote:

---

Originally Posted by alley

Chris, the project is related to matching some content against downloaded content from the internet.

---

If possible, post your assignment specification for us to read :)

Quote:

---

Originally Posted by JavaPF

I just read your post

If possible, post your assignment specification for us to read :)

---

I would love to give details as much as possible, but the requirement is for us to choose a project on some field which is not the work of ours, and the University stresses a lot on plagiarism, so if I post the exact details on the internet it would be worldwide, and someone else could indulge in a similar project resulting in the project not being accepted since they have very efficient plagiarism detecting software.

I hope you understand my concern :-<, but I will happily share any details when my project is finished and marked by the University. :-bd

OK alley I totally understand. That's a very sensible approach.

When you need help understanding certain aspects of your project, let me know and I will give as much guidance as possible.

Thanks for your understanding and your help JavaPF!

I'll do my best to help you out. If you don't wan to post actual spec which is very wise, then when you have a problem make a slightly different example that demonstrates what problem you are having, that way it wont be the same as your project :P

Chris