Posted By

gdvickery on 03/12/09

Tagged

http
java

Versions (?)

Last Edited at 03/12/09 11:16am

Statistics

Viewed 720 times

Favorited by 2 user(s)

Related snippets

Read a web page with Java

/ Published in: Java

Connects to a web page, reads in the content and strips whitespace.

Expand | Embed | Plain Text

Copy this code and paste it in your HTML

public String readURL(String address) throws Exception
{
    URL url = new URL(address);
    HttpURLConnection conn = (HttpURLConnection)url.openConnection();
    conn.setReadTimeout(5000);
    conn.setConnectTimeout(5000);
 
    ByteArrayOutputStream out = new ByteArrayOutputStream();
    byte[] buff = new byte[1024];
    InputStream in = conn.getInputStream();
    int read;
 
    while((read = in.read(buff)) != -1)
        out.write(buff, 0, read);
 
    return out.toString().replaceAll("[\\s]+", " ");
}