Import Rest API Data into SQL server using Azure Data Factory (ADF)

Ditutup Disiarkan 2 bulan lepas Dibayar semasa penghantaran
Ditutup Dibayar semasa penghantaran

Hi There,

I have REST API and I need to import the data into a Azure SQL Server table.

I am using Azure Data Factory Data flow (attached) which was working fine but as the data grew I started getting the below error

Azure data factory REST API Job aborted due to stage failure: Serialized task 16:0 was bytes, which exceeds max allowed: [login to view URL] (134217728 bytes).

So I had to split the source API data into two parts using $top and $skip

Like below, two URL calls.

abc?$expand=xx,yy,zz&$top=40000&$skip=0

abc?$expand=xx,yy,zz&$top=40000&$skip=40000

I am looking for efficient way of doing it by using for loop or parametrization or anything which makes it work even if the data further grows.

Example API data : [login to view URL]$expand=Trips

If you can use above api and import all the data fields into SQL server.

ADF / Oracle ADF Azure Pelayan Microsoft SQL JSON

ID Projek: #37514388

Tentang projek

12 cadangan Projek jarak jauh Aktif 1 bulan lepas

12 pekerja bebas membida secara purata $43 untuk pekerjaan ini

vw7590795vw

I read your requirement for Azure Data Factory. I will check your REST API data and help you to resolve your problem. I have good experience in import data at SQL Server. You can view my profile for completed project Lagi

$29 AUD dalam sehari
(15 Ulasan)
3.9
akhileshgandhi

Hello, We would like to assist you with your requirements for importing Rest API data into a SQL server using Azure Data Factory (ADF). We have expertise in ADF, Oracle ADF, Azure, and Microsoft SQL Server. I underst Lagi

$30 AUD dalam 7 hari
(7 Ulasan)
3.2
Samaji206

Hello I understand your request that you’re demanding Import Rest API Data into SQL server using Azure Data Factory (ADF) As a Professional Geeks, I can avail creative, proactive and high-tech solutions to your devel Lagi

$20 AUD dalam sehari
(0 Ulasan)
0.0
durgesh8527

Hello there! My name is Pllavi and I am a full-time web and mobile app developer working as a freelancer. I understand that you need to import data from REST API into Azure SQL server using Azure Data Factory (ADF). Lagi

$30 AUD dalam 7 hari
(0 Ulasan)
0.0
anayapallavi

I can Import Rest API Data into SQL server using Azure Data Factory. Please initiate a message for further discussion.

$50 AUD dalam 2 hari
(0 Ulasan)
0.0
anaya8777

I can help you in Importing Rest API Data into SQL server using Azure Data Factory (ADF). Lets connect and discuss.

$50 AUD dalam 2 hari
(0 Ulasan)
0.0
avetech2013

Hello Employer, How are you? Hope you are in your best spirits. I have 5 years of project management and virtual assistance experience in various industries. In my 10 years of IT programming experience working on t Lagi

$30 AUD dalam 7 hari
(0 Ulasan)
0.0
fl0colin

For this task, we can use pagination rules to achieve your needs. I have tested with the example API you shared. Dataflow does not support range, but we can use one copy activity follow by your dataflow to flatten the Lagi

$40 AUD dalam 5 hari
(0 Ulasan)
0.0