Add field comparable to firstHtml to the har.request tables

[rviscomi]

The runs.request tables include a firstHtml field to indicate that the request is for the parent document.

Queries on the har.request tables must join on the corresponding runs table to get this info. There are tens of millions of requests in each table, so the join is expensive.

To simplify queries and make them less expensive, add a boolean field comparable to firstHtml to the har.request tables. It should share the same logic as the runs table; first 200 response with HTML mime type.

[igrigorik]

Would this be a step in the Dataflow pipeline?

[rviscomi]

Yes, it should be annotated during the iteration over the requests in the HAR file:

bigquery/dataflow/java/src/main/java/com/httparchive/dataflow/BigQueryImport.java

Line 252 in 0489d8e

for (final JsonNode r : entries) {

This field would also be valuable on the har.bodies tables.