From CS 455/555 Fall 2009

CS455-F09: Program 3: HTTP Request Capture and HTTP Client

Assigned: Tuesday, October 27, 2009
Due: Tuesday, November 10, 2009 before class

Description

The goal of this assignment is to help you become familiar HTTP requests and HTTP responses. We'll be implementing an HTTP request capture program so that you can look at requests generated by your favorite web browser and a simple HTTP client so that you can practice building valid HTTP requests and processing HTTP responses from real web servers.

HTTP Request Capture

• The HTTP request capture program must be named HTTPReqCap.java.
• It must accept a single command-line argument: port, which is the port that it will listen on for incoming HTTP requests.

• For each new HTTP request, print the client's IP address and port in the format IP:port

• Print each line in the HTTP request.
• You do not need to return anything to the client. (Note that this will typically cause the browser to display a blank page.)
• Close the socket after you have printed the entire HTTP request.
• To get the browser to request something from your server, use the hostname and port your server is running on in the URL.

• Since the CS servers only allow connection to user ports (10000-11000) from on-campus, make sure that the browser you are testing with is on-campus (or you won't be able to reach your server program). You can run 'firefox &' or 'mozilla &' from any of the Sun machines if you're working on this from home and need to test (make sure that you have X-Win32 or another XWindows server running at home first).

Hints:

• Remember how HTTP requests are formatted and terminated.
• Note that readLine() strips off newline characters before returning a String.
• Use the equals() method to compare two Strings.

HTTP Client

• The HTTP client program must be named HTTPClient.java.
• It must accept a single command-line argument: URL, which is the URL that it will request.
  • The URL will be given in the following format: http://hostname[:port][/path] (only lowercase letters will be used)
    • hostname - the web server's hostname
    • :port - an optional port
    • path - the path from the web server's main directory to the requested file, if this is not present, then the path is '/'
  • As with the Programs 1 and 2, if any of the arguments are incorrect, exit after printing an error message of the form ERR - arg x, where x is the argument number.
  • Treat any URL as valid as long as it starts with http://
• Connect to the host given in the URL at the port given in the URL (use 80, if no port is given).
• Request the path/file given in the URL using HTTP/1.0.
  • Use the HEAD method so that only the HTTP response header will be returned.
  • Your request must include the Host field (with the proper entry).
  • Your request must also include the User-agent field with the entry 'ODU-CS455/555'.
  • No other request fields are needed.
• Print the HTTP request sent to the server.

• Parse the HTTP response header received from the server and print the following information:
  • Response code (number)
  • Server type
  • If the response is in the 200-level:
    • Last modified date
    • Number of bytes in the response data
  • If the response is in the 300-level:
    • The URL where the file is located
• Print the HTTP response header.

Rules

• As with all projects, you are not permitted to work with anyone else (even students not in the class) - all of the coding and documentation must be your own.
• Your programs must compile and run on the CS Unix machines.
• You must write neat code and document it well. You will lose points for sloppy programs that contain little or no comments.

Testing

A large part of your program's grade will be determined by how well it handles a set of inputs. You should test your program rigorously before submitting. Because your programs will be run and tested using a script, you must format your output exactly as I have described or you will lose points.

Example 1

java HTTPReqCap
Usage: java HTTPReqCap port

Example 2

java HTTPReqCap 10003
128.82.4.118:33083
GET /my/url HTTP/1.1
Host: antares.cs.odu.edu:10003
User-Agent: Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7) Gecko/20070606
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive

Example 3

java HTTPClient 
Usage: java HTTPClient URL

Typo fixed (no java) -MCW 11/03/09

Example 4

java HTTPClient http://www.cs.odu.edu/~mweigle/files/foo.txt
HEAD /~mweigle/files/foo.txt HTTP/1.0
Host: www.cs.odu.edu
User-agent: ODU-CS455/555

200
Apache/2.2.0
Sat, 16 Sep 2006 17:38:59 GMT
95

HTTP/1.1 200 OK
Date: Thu, 19 Feb 2009 20:54:19 GMT
Server: Apache/2.2.0
Last-Modified: Sat, 16 Sep 2006 17:38:59 GMT
ETag: "7ab46d-5f-9da4d2c0"
Accept-Ranges: bytes
Content-Length: 95
Connection: close
Content-Type: text/plain

Submission

You must name your source files HTTPReqCap.java and HTTPClient.java (note the capitalization). Make sure that you submit all files necessary to compile your program. But, do not submit compiled files (.class files).

Directions for submitting your assignment through Blackboard