'Using Airbyte to get data from websites/datasets platforms like kaggle
I am new to Airbyte, our team is looking to use airbyte for different sources - ranging from http api (web scraped website) to websites containing datasets like kaggle etc. we are looking to create custom connectors for these sources. I am looking for some guide on how to get started with this resources.
I have implemented the custom connector for a sample api using below guide. https://docs.airbyte.com/connector-development/tutorials/cdk-tutorial-python-http/creating-the-source
I need to look at other ways of
- getting data from a website (scrapped into my destination) using custom connector.
- getting data from kaggle or equivalent data source using custom connector. please let me know how to achieve above tasks.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|