Scrape Website

Scrape websites and convert content to markdown

1 credit per call

Method

services.scrape.website(params);

Input

url · string · required

URL to scrape (must start with http:// or https://)

params.limit · number · default: 1

Number of pages to scrape (follows links)

Output

markdown · string

Combined markdown content from all pages

data · array

Per-page data: - markdown - Page content as markdown - links - Links found on page

socialUrls · object

Extracted social/contact URLs: - emailGeneral - Emails found - phoneGeneral - Phone numbers - linkedinProfile / linkedinCompany - LinkedIn URLs - facebookProfile / instagramProfile / twitterUser - Social profiles - youtubeChannel / tiktokProfile - Video platforms

Example

const result = await services.scrape.website({
  url: "https://example.com/about",
});

return result.markdown;

// Extract contact info
const result = await services.scrape.website({
  url: ctx.thisRow.get("Website"),
});

return result.socialUrls.emailGeneral[0];