fdy-scraping

fdy-scraping is a versatile HTTP client designed for making API requests with support for proxy configuration, debugging, and detailed error handling. It utilizes the got-scraping library for HTTP operations.

Installation

To use fdy-scraping, you need to install the got-scraping library. Run the following command to install it via npm:

1npm install fdy-scraping

Usage

Importing the Client

Import fdy-scraping into your Node.js application:

1const fdy = require("fdy-scraping");

OR

1import fdy from "fdy-scraping";

Creating a Client Instance

Create a new client instance with custom options:

1create(options?: FetchClientOptions, debug?: boolean): FdyFetchClient;

1const client = fdy.create(
2  {
3    headers: { Authorization: "Bearer your-token" },
4    proxy: {
5      ip: "127.0.0.1",
6      port: 8080,
7      protocol: "http",
8      username: "username",
9      password: "password",
10    },
11    baseUrl: "https://api.example.com",
12  },
13  true
14); // Set debug mode to true

Making HTTP Requests

You can use the client to make various types of HTTP requests:

Request

1request(url, method, body = undefined, headers = undefined, options = undefined)

1client
2  .request("/endpoint", "POST", undefined, { Accept: "application/json" })
3  .then((response) => {
4    console.log(response.data); // Response data
5  })
6  .catch((error) => {
7    console.error("Error:", error.message);
8  });

GET Request

1get(url, headers = {}, options = {}, enableDebug = false)

1client
2  .get("/endpoint", { Accept: "application/json" })
3  .then((response) => {
4    console.log(response.data); // Response data
5  })
6  .catch((error) => {
7    console.error("Error:", error.message);
8  });

POST Request

1post(url, body = undefined, headers = {}, options = {}, enableDebug = false)

1client
2  .post("/endpoint", JSON.stringify({ key: "value" }), {
3    "Content-Type": "application/json",
4  })
5  .then((response) => {
6    console.log(response.data); // Response data
7  })
8  .catch((error) => {
9    console.error("Error:", error.message);
10  });

PUT Request

1put(url, body = undefined, headers = {}, options = {}, enableDebug = false)

1client
2  .put("/endpoint", JSON.stringify({ key: "new-value" }), {
3    "Content-Type": "application/json",
4  })
5  .then((response) => {
6    console.log(response.data); // Response data
7  })
8  .catch((error) => {
9    console.error("Error:", error.message);
10  });

DELETE Request

1delete(url, headers = {}, options = {}, enableDebug = false)

1client
2  .delete("/endpoint", { Accept: "application/json" })
3  .then((response) => {
4    console.log(response.data); // Response data
5  })
6  .catch((error) => {
7    console.error("Error:", error.message);
8  });

Error Handling

fdy-scraping provides detailed error information through the FdyFetchClientError class. Errors include the status code, response data, and request configuration.

1client.get("/invalid-endpoint").catch((error) => {
2  if (error instanceof fdy.FdyFetchClientError) {
3    console.error("Custom Error Details:");
4    console.error("Status:", error.status);
5    console.error("Response:", error.response);
6    console.error("Config:", error.config);
7  } else {
8    console.error("General Error:", error.message);
9  }
10});

Configuration Options

FetchClientOptions

• headers: Optional object containing default headers for requests.
• proxy: Optional object for proxy configuration.
  • ip: IP address of the proxy server.
  • port: Port of the proxy server.
  • protocol: Protocol used by the proxy (http or https).
  • username: Optional username for proxy authentication.
  • password: Optional password for proxy authentication.
• baseUrl: Optional base URL for requests.

Debug Mode

Debug mode can be enabled by passing true as the second argument to FdyFetchClient.create. When enabled, additional error information will be logged to the console.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Feel free to adjust the paths, options, or methods according to your actual implementation and package setup.