Twisted's doRequest returning empty response.body?
At 2013-07-02 18:25:33 Collin Anderson wrote: Lovely OONI people, README.md did not recommend which trac to use, so here I am.
I have been playing with porting some personal testing scripts to the framework and come to appreciate a limitation in doRequest. It seems that unless a responding server returns a very specific set of headers, twisted records that response.body is an empty string. After hours of nginx annoyance, I found through running a simple node.js that at least 'Content-Type', e.g. 'text/html; charset=iso-8859-1', had to be set (if not 'Trailer' or others). This affects http_requests.py as a substantial number of sites return empty bodies over both connections.
This issue was automatically migrated from github issue https://github.com/TheTorProject/ooni-probe/issues/125