Pyschologytoday Scraper

What it does

Choose a category (therapists / psychiatrists / groups / treatment-rehab) and one or more US states (or all states). The actor scrapes list pages to collect core lead info, then optionally enriches each profile by opening the details page and extracting deeper fields plus emails from the provider’s own website. It uses a lightweight parser for list/profile pages, and uses Playwright only to pass the PsychologyToday “website interstitial” and load the actual therapist site for email extraction.

Key data fields

• Name
• Title
• Address (e.g., Online Only or city)
• Phone
• Image
• Profile URL (detailsUrl)
• Short Description
• Long Description (details mode)
• PsychologyToday website interstitial URL (psychologytoday_website)
• Provider Website URL (website)
• Emails (cleaned & deduplicated)
• Insurances (comma-separated)
• Qualifications (license / education / years in practice)
• Top Specialties
• Expertise
• Client Focus
• Treatment Approach
• Locations (joined by commas)

How to use

1. Select category (therapists / psychiatrists / groups / treatment-rehab).
2. Select states (one, many, or all). Set maxPagesPerState / maxItems to control volume.
3. Choose scrapeMode: list-only or list + details enrichment.
4. Run the actor on Apify and export results as CSV/JSON from the dataset.

Sample Output JSON

[{
  "name": "John Doe",
  "title": "Psychiatric Nurse Practitioner, PMHNP-C, FNP-BC",
  "address": "Online Only",
  "shortDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options...",
  "image": "https://photos.psychologytoday.com/xxxx/3/320x400.jpeg",
  "detailsUrl": "https://www.psychologytoday.com/us/psychiatrists/xxxx/000000",
  "phone": "(315) 000-0000",
  "longDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options... I'm here and ready to help.",
  "psychologytoday_website": "https://www.psychologytoday.com/us/profile/000000/website",
  "website": "https://care.headway.co/providers/john-doe",
  "emails": "email1@xxx.co,email2@hotmail.com",
  "insurances": "Aetna,Anthem,Blue Cross,Blue Shield,Cigna and Evernorth,Empire Blue Cross Blue Shield",
  "qualifications": "Verified by Psychology Today License: New York / 401606 ... Graduated 2013",
  "topSpecialties": "Coping Skills,Anxiety,Women's Issues",
  "expertise": "Coping Skills,Anxiety,Women's Issues,Addiction,Depression,Grief,Stress,Substance Use,Veterans",
  "clientFocus": "Children (6 to 10),Preteen,Teen,Adults,Elders (65+),Individuals",
  "treatmentApproach": "Cognitive Behavioral (CBT),Mindfulness-Based (MBCT),Motivational Interviewing,Person-Centered,Strength-Based",
  "locations": "La Fayette, NY 13084"
}]