Moving data? Integrating systems? Right ETL tool is your best friend


When it comes to exporting data from one application and importing them into another one, many of the old-school .NET coders just jump right into what they know best: code away to map the source and target.

Wrong approach!

If these data-sets happen to be large, I've seen so many developers just working away nights and weekends as their code moves data on row at a time. Add some business rules and logic in the mix, project becomes a disaster.

These days, there are just too many good ETL tools out there. Some are very feature-rich with a ton of out-of-box connectors.  Look for one that fits your budget and meets your need. Don't forget to consider the learning curve needed and the folks you have in your team.

I've been using the suite for Simego for a while for many data migration, integration and automation projects

Data Synchronization Studio - XML Files


Just an awesome tool that works fast for moving millions of rows of data between systems including

  1. Dynamics CRM
  2. Oracle
  3. SQL Server
  4. Text files
  5. CSV files
  6. Excel
  7. Web API
  8. Custom Data sources
  9. XML files
  10. Many more
Simego works and runs fast!
Check it out!

Don't write codes with loops for moving data. 
Use the best tool your money can buy.

Comments

Post a Comment

Popular posts from this blog

Testing PDF forms with merge code fields - let's just build a tool

Image
My team has been tasked with a lot of PDF forms that needs to be designed and coded for merge fields. These fields are coming from a very large list with exact names of merged code fields and sample values to go with them. Once they are built, team needs to test form naming of the fields and formatting of values in them. A ton of really boring hours of manual typing and populating values in each field so we test for consistency and formatting before we upload them to the destination web app that uses these. Time for a little automation to help the team. Needed to build a little app that takes Folder containing PDF forms with merge code fields List of Merge Code filed names and sample values As input. Click a button and get these PDF forms populated with applicable sample values and flatten them. Here are the results: Windows Forms app Loop through the directory to find and process all pdf forms Loop through form fields in each PDF.  Log ...
Read more

Dynamics CRM implementation: lessons learnt

2015 has been one heck of year for me personally and professionally. Just finished implementing Microsoft Dynamics CRM 2015 for a fairly large group of users. This is my second full blown CRM project from inception to implementation. First one was Microsoft Dynamics CRM 2011 On-Premise. This one is MS Dynamics CRM 2015 Online. Both involved convincing business and IT folks on why choose CRM as the tool to solve the chosen problems. A ton of lessons learnt, as I have done with every project in my professional career. Here's a few in the form of advice. I have put them into 3 main categories: product, process and people. I consider all 3 to be vital for any successful IT project. 1. Product: You can't afford to miss this one You have picked Microsoft Dynamics CRM 2015 to solve business processes. Smart move! Now, know your product very well as soon as possible. Research, review and decide on all additional tools to go with CRM as well as othe...
Read more