木偶师

木偶师"/>

木偶师

我正在使用 Puppeteer 来绕过 cloudflare 安全性。
长话短说，我需要执行一个

POST

\n

{ json string 1 }
{ json string 2 }
...

W当普通浏览器执行此请求时（当站点按应有的方式使用时），它只是获取此 url，等待它的响应，并且文本正在页面上显示。在 DevTools 中可以将响应本身视为带有

application/octet-stream

GoToAsync

NavigationException: net::ERR_ABORTED

try-catch

 Stream

这是我使用的示意性代码示例：

var browserFetcher = new BrowserFetcher();
await browserFetcher.DownloadAsync();
var browser = await Puppeteer.LaunchAsync(new() { Headless = true });
var page = await browser.NewPageAsync();

await page.SetRequestInterceptionAsync(true);
await page.Client.SendAsync("Page.setDownloadBehavior", new
{
    behavior = "allow",
    downloadPath = "_path_"
});

page.Request += async (s, e) =>
{
    // sets method to POST, adds some headers, specifies post-data
    var payloadOverride = new Payload() { ... };
    await e.Request.ContinueAsync(payloadOverride); // executes normally and leaves code block
};

var response = await page.GoToAsync($"url"); // will throw exception "somewhere in await"

此外，我尝试做这样的事情：

page.Response+= async (s, e) =>
{
    await e.Response.TextAsync();
    await e.Response.JsonAsync();
    await e.Response.BufferAsync();
};

当

GoToAsync

.Response

net::ERR_ABORTED

PuppeteerSharp.BufferException: "Unable to get response body"

此外，我尝试使用

Evaulate

fetch()

fetch(...).then((response) => response.text())

GoTo

Evaulate

HttpClient

HttpRequestMessage request = new(HttpMethod.Post, "same url");
// ...setting post-data and headers...
var response = await _httpClient.SendAsync(request);

// => It will return simple text with few lines, as in example in beginning
string content = await response.Content.ReadAsStringAsync();
string[] chunks = content.Split("\n"); // => and here I have array of JSON string ["{ }", "{ }", ...]

如有任何建议，我们将不胜感激。我使用 Puppeteer 的

.NET

JS

到目前为止我找到的解决方案： 第一的： 只需在

Puppeteer Stealth Plugin

fetch()

EvaluateFunctionAsync()

第二： 这就是我在知道隐形插件之前使用的东西。

string someDownloadPath = "";
var page = await _browser.NewPageAsync();
await page.SetRequestInterceptionAsync(true);

// allows regular downloads for a headless mode
await page.Client.SendAsync("Page.setDownloadBehavior", new { behavior = "allow", someDownloadPath });

// sending POST with GoToAsync
page.Request += (s, requestArgs) => YourContinueRequestHandler(requestArgs, HttpMethod.Post, data);

// it will ALWAYS throw an exception
try { await page.GoToAsync(url); }
catch (NavigationException)
{
    // puppeteer will download content as a binary file with a "download" name
    string responsePath = $"{someDownloadPath}/download";

    // Wait 30 seconds for a response to download
    for (int i = 0; i < 15; i++)
    {
        await Task.Delay(2000);
        if (File.Exists(responsePath)) break;
    }
    var content = await File.ReadAllTextAsync(responsePath);
}