【问题标题】:Gzip, HTMLAgilitypackGzip、HTMLAgilitypack
【发布时间】:2018-12-10 07:45:30
【问题描述】:
HTMLAgillityPack 中的 Gzip 存在一些问题
错误 - 'gzip' 不是受支持的编码名称
代码:
var url = "http://poe.trade/search/arokazugetohar";
var web = new HtmlWeb();
var htmldoc = web.Load(url);
【问题讨论】:
标签:
c#
parsing
gzip
html-agility-pack
【解决方案1】:
您可以使用以下方法添加 gzip 编码。
var url = "http://poe.trade/search/arokazugetohar";
HtmlWeb webClient = new HtmlWeb();
HtmlAgilityPack.HtmlWeb.PreRequestHandler handler = delegate (HttpWebRequest request)
{
request.Headers[HttpRequestHeader.AcceptEncoding] = "gzip, deflate";
request.AutomaticDecompression = DecompressionMethods.Deflate | DecompressionMethods.GZip;
request.CookieContainer = new System.Net.CookieContainer();
return true;
};
webClient.PreRequest += handler;
HtmlDocument doc = webClient.Load(url);