Welcome to the Java Programming Forums


The professional, friendly Java community. 21,500 members and growing!


The Java Programming Forums are a community of Java programmers from all around the World. Our members have a wide range of skills and they all have one thing in common: A passion to learn and code Java. We invite beginner Java programmers right through to Java professionals to post here and share your knowledge. Become a part of the community, help others, expand your knowledge of Java and enjoy talking with like minded people. Registration is quick and best of all free. We look forward to meeting you.


>> REGISTER NOW TO START POSTING


Members have full access to the forums. Advertisements are removed for registered users.

Results 1 to 2 of 2

Thread: Get "Object Moved" error when using url.openConnection and .connect

  1. #1
    Junior Member
    Join Date
    Sep 2011
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default Get "Object Moved" error when using url.openConnection and .connect

    Hello,
    I have been using Matlab Java Virtual Machine (Java 1.6.0_27-b07 with Sun Microsystems Inc. Java HotSpot(TM) Client VM mixed mode) for the past 2 years to login to an https site to look for high school teaching substitute job postings, and accept jobs that I would want. Everything was working great until a couple of months ago. I started getting an error when I ran the program. I looked deeper and saw that I was still able to securely log into the site, but when I went to the job search page, it read:
    "<head><title>Object moved</title></head>
    <body><h1>Object Moved</h1>This object may be found <a HREF="http://www.aesoponline.com/login.asp">here</a>.</body>"

    The problem is that http://www.aesoponline.com/login.asp is not the page I want to go to. When I use any browser to go to the search page, I get the correct page and there is no "Object Moved" error.

    I have read this may happen if the server thinks you are not a normal browser (an automated computer program trying to access the site). So I have tried adding:
    "urlConnection.setRequestProperty('User-agent','Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)');"
    to make the server think it is a browser. But this did not help.

    I also tried:
    "urlConnection.setFollowRedirects(true);"
    to see if it would redirect, but this also did not work.

    The strange part is that this all of a sudden started happening a couple months ago, when it worked fine for 2 years before that.

    I should mention I am using Matlab because I need to use the image proccessing toolbox because a captcha is used when I accept jobs.

    I would appreciate any help I can get. Thanks in advance!

    Here is the code I am using after logging into the site and getting the correct cookies ("my_cookie"). "search_page_source_code" is where I read "Object Moved...":

    url = java.net.URL('https://www.aesoponline.com/subweb/sub_searchforjobs.asp?x=x');

    urlConnection = url.openConnection();

    %% Add cookie info

    urlConnection.setRequestProperty('Cookie',my_cooki e);

    %% Connect

    urlConnection.connect();


    %% Get source code of search page
    inputStream = urlConnection.getInputStream;
    byteArrayOutputStream = java.io.ByteArrayOutputStream;
    % This StreamCopier is unsupported and may change at any time.
    isc = InterruptibleStreamCopier.getInterruptibleStreamCo pier;
    isc.copyStream(inputStream,byteArrayOutputStream);
    inputStream.close;
    byteArrayOutputStream.close;
    search_page_source_code = native2unicode(typecast(byteArrayOutputStream.toBy teArray','uint8'),'UTF-8');


  2. #2
    Super Moderator Sean4u's Avatar
    Join Date
    Jul 2011
    Location
    Tavistock, UK
    Posts
    637
    Thanks
    5
    Thanked 103 Times in 93 Posts

    Default Re: Get "Object Moved" error when using url.openConnection and .connect

    Your only hope may be to write some kind of proxy to look at all the web traffic between browser and server (some browsers have good HTTP header reporting), or use something like Wireshark to examine the HTTP traffic and see where your bot differs from your browser. Are you adequately handling header fields for cookies and referers?

Similar Threads

  1. Replies: 7
    Last Post: August 13th, 2011, 01:22 AM
  2. JFileChooser save dialog box "access is denied" error
    By byrdman in forum What's Wrong With My Code?
    Replies: 7
    Last Post: August 2nd, 2011, 01:45 PM
  3. Replies: 6
    Last Post: November 12th, 2010, 03:40 AM
  4. Replies: 1
    Last Post: March 31st, 2010, 09:42 PM
  5. "java.lang.NoSuchMethodError: main" and "fatal exception occured."
    By joachim89 in forum What's Wrong With My Code?
    Replies: 2
    Last Post: January 10th, 2010, 07:35 AM

Tags for this Thread