claude
898dd09d50
Introduces page-fetcher-api, a new internal ASP.NET Core service that centralises all web-page fetching through a single Playwright (headless Chromium) browser instance. All fetches are persisted to the pageFetcher SQL schema for auditing. New projects: - Apis/page-fetcher-api-models: FetchPageRequest, FetchPageResponse, IPageFetcherApiClient - Apis/page-fetcher-data: PageFetchDbContext, PageFetchEntity, InitialSchema migration (schema: pageFetcher) - Apis/page-fetcher-api: PlaywrightBrowserService (singleton), PageFetcherService, PageController Changes to existing services: - cv-matcher-api: JobTextExtractor now calls IPageFetcherApiClient instead of HttpClient - cv-search-job: HtmlJobSearcher uses IPageFetcherApiClient (removes inline Playwright); CvSearchJobTask fetches individual job pages and applies keyword pre-filter before LLM call; passes pre-fetched JobDescription to cv-matcher-api to skip re-fetch - common: add PageFetcherApiSettings - docker-compose.yml, build.yml: add new service + env vars for callers Closes #43 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
18 lines
664 B
C#
18 lines
664 B
C#
namespace PageFetcherApi.Services;
|
|
|
|
/// <summary>
|
|
/// Runtime settings for the page-fetcher service.
|
|
/// Bound from the <c>PageFetcher</c> configuration section.
|
|
/// </summary>
|
|
public sealed class PageFetcherSettings
|
|
{
|
|
/// <summary>Default Playwright wait condition (<c>networkidle</c>, <c>load</c>, <c>domcontentloaded</c>).</summary>
|
|
public string DefaultWaitFor { get; set; } = "networkidle";
|
|
|
|
/// <summary>Page navigation timeout in seconds.</summary>
|
|
public int TimeoutSeconds { get; set; } = 30;
|
|
|
|
/// <summary>Maximum characters stored/returned in the extracted text field.</summary>
|
|
public int MaxTextChars { get; set; } = 60_000;
|
|
}
|