Name: Pipfeed – Article to JSON | Free · $5/mo | API.market
Brand: pipfeed
SKU: api-pipfeed-parse
Availability: InStock
Rating: 5.00 (2 reviews)
Author: API Market

Shashank Agarwal

**📢 🔥 50% discount for a limited time. 🔥**

## 📰 Pipfeed News Article Data Extract and Summarization API: Scrape, Parse & categorize any news article 

Stop wrestling with web scraping! The Pipfeed API extracts main article content and metadata from news and blogs, handling geo-restrictions and client-side rendering. Free your developers to focus on building amazing applications. Sign up for a free trial and see the difference! 

Automatic data extraction from articles, products, discussions, and more. This API uses advanced AI technology to retrieve clean, structured data without the need for manual rules or site-specific training.

The most advanced article extraction API with AI/ML summary, category prediction, all images, blog logo, authors, keywords, tags, and more.


>  Enter a URL of a any text article or post and get clean JSON with title, summary, text and all other properties.


### 🔗 [API Docs](https://docs.pipfeed.com)

One API can help you achieve various use cases. These are some of the use cases our customers Pipfeed's API help enable:

- Add "Reader Mode" to your apps.
- Send "summarized" content to your readers.
- Use parsed data in training AI models.
- Allow readers to download the content and read it offline.

> Avoid months of development time building your custom URL extractor
We have spent months fine-tuning each small part of our article extract API so you don't have to. 

### Features:

**Extracts full HTML/Text**
Using A.I. we extract full HTML even from javascript-heavy websites.

**Consistent Categories**
Get auto predicted categories to better organize your extracted content

**Metadata**
Get full metadata of the article including images, keywords, tags, and more.

The Pipfeed API is the most advanced article extraction API, leveraging AI/ML for comprehensive content extraction and analysis. It provides article summaries, category predictions, images, blog logos, authors, keywords, tags, and more.

#### Features:
- **Advanced Extraction:** Extract full HTML and text, even from JavaScript-heavy websites using AI.
- **Consistent Categories:** Auto-predict categories to organize your content better.
- **Comprehensive Metadata:** Retrieve full metadata including images, keywords, tags, and more.
- **No Proxy Needed:** Pipfeed API handles geo-restrictions and client-side rendering seamlessly, eliminating the need for proxies.
- **Universal Compatibility:** Works for all types of content, ensuring you never have to handle restricted content.

#### Additional Benefits:
- **Handles Geo-Restrictions:** Seamlessly extract content from geographically restricted websites.
- **Client-Side Rendering:** Efficiently handle client-side rendered content.
- **Structured Data Output:** Converts articles into structured JSON data.
- **Embeddable Media Extraction:** Extracts YouTube, Twitter cards, RSS feeds, and social media feeds.

Features:
- Extracts full HTML/Text
Using A.I. we extract full HTML even from javascript-heavy websites.

- Consistent Categories
Get auto predicted categories to better organize your extracted content

- Metadata
Get full metadata of the article including images, keywords, tags, and more.

### Extracted Fields Descriptions:

- **Date Published:** The publication date and time of the article.
- **Title:** The headline or title of the article.
- **Authors:** The names of the authors who wrote the article.
- **Description:** A brief summary or description of the article.
- **Language:** The language in which the article is written.
- **URL:** The web address of the article.
- **Main Image:** The primary image associated with the article.
- **HTML Content:** The full HTML content of the article.
- **Text Content:** The plain text content of the article.
- **Category:** The primary category assigned to the article.
- **Predicted Categories:** The top predicted categories for the article using AI.
- **Tags:** Tags or keywords associated with the article.
- **Keywords:** The most important keywords in the article.
- **Summary:** An AI-generated summary of the article.
- **All Images:** All images included in the article.
- **Blog Name:** The name of the blog or website where the article is published.
- **Blog Logo URL:** The URL of the blog's logo.
- **Content Length:** The length of the article content in characters.
- **Sentiment Analysis:** Sentiment score and analysis of the article's content.



## Request

```shell
curl -X 'POST' \
  'https://api.magicapi.dev/api/v1/pipfeed/parse/extract' \
  -H 'accept: application/json' \
  -H 'x-magicapi-key: your-api-key' \
  -H 'Content-Type: application/json' \
  -d '{
  "url": "https://techcrunch.com/2022/04/18/web-scraping-legal-court/"
}'
```

## Response

```
{
  "url": "https://techcrunch.com/2022/04/18/web-scraping-legal-court/",
  "title": "Web scraping is legal, US appeals court reaffirms | TechCrunch",
  "author": "Zack Whittaker",
  "html": "<div class=\"page\" id=\"readability-page-1\"><div><p id=\"speakable-summary\">Good news for archivists, academics, researchers and journalists: Scraping publicly accessible data is legal, according to a U.S. appeals court ruling.</p>\n<p>The landmark ruling by the U.S. Ninth Circuit of Appeals is the latest in a long-running legal battle brought by LinkedIn aimed at stopping a rival company from web scraping personaght to protect our members’ ability to control the information they make available on LinkedIn. When your data is taken without permission and used in ways you haven’t agreed to, that’s not okay. On LinkedIn, our members trust us with their information, which is why we prohibit unauthorized scraping on our platform.”</p>\n<blockquote data-secret=\"ILEgjf6kYo\"><p><a href=\"https://techcrunch.com/2021/06/03/supreme-court-hacking-cfaa-ruling/\">Supreme Court limits US hacking law in landmark CFAA ruling</a></p></blockquote>\n\n</div></div>.......",
  "text": "Good news for archivists, academics, researchers and journalists: Scraping publicly accessible data is legal, according to a U.S. appeals court ruling.\nThe landmark ruling by the U.S. Ninth Circuit of.......\n\n",
  "length": 3533,
  "description": "The landmark web scraping case was bounced back to the Ninth Circuit by the U.S. Supreme Court.",
  "siteName": "TechCrunch",
  "topImage": "https://techcrunch.com/wp-content/uploads/2022/04/GettyImages-1303427084-reworked.jpg",
  "date": "2022-04-18T19:16:57+00:00",
  "keywords": "",
  "summary": [
    "The landmark ruling by the U.S.",
    "The case reached the U.S.",
    "Supreme Court last year but was sent back to the Ninth Circuit for the original appeals court to re-review the case.",
    "But there have been egregious cases of web scraping that have sparked privacy and security concerns.",
    "Supreme Court limits US hacking law in landmark CFAA ruling"
  ],
  "sentiment": {
    "score": 31,
    "comparative": 0.05486725663716814,
    "calculation": [
      {
        "landmark": 2
      },
      {
        "limits": -1
      },
.......
      {
        "legal": 1
      },
      {
        "accessible": 1
      },
      {
        "good": 3
      }
    ],
    "postive": [
      "landmark",
      "supreme",
      "trust",
      "agreed",
.......
      "win",
      "accessible",
      "good"
    ],
    "negative": [
      "limits",
      "prohibit",
      "fight",
.......
      "fraud",
      "violation",
      "stopping",
      "battle"
    ]
  }
}
```

Convert any news article or blog post URL to clean JSON. Includes AI summary & tags. Free 500 calls/mo, from $5/mo. Start free on API.market.

Pipfeed – Article to JSON | Free · $5/mo | API.market

Article Parser/Extractor

Free

pipfeed

PAYG

Start

Ultra

GIGA

Mega

Bulk

One of the best APIs for parsing and scraping news articles—simple to use, affordable, and consistently reliable.

Great API to use for extracting important data and summarize web pages