Whilst working at a Water Corporation a while back, I had to migrate 250k records from Records Manager to Content Manager 9. The documents themselves were straightforward, but the transformations of the related metadata were extreme (including nested lists). I used Power Query for this and although good for understanding data quality, it was very manual and would hang on large datasets.
Finding a good and cost effective ETL (Extract, Transform and Load) platform is difficult, particularly something that is corporate grade. You maybe familiar with FME Workbench – particularly those of you that look after GIS. It’s a great tool but expensive. You’ll be pleased to know that there is a cloud based Microsoft equivalent – Azure Data Factory.
We are using Data Factory to pull data from a data warehouse (containing legacy ERP data), perform some minor transformations, and then push it into the Dataverse. The data is then made available to staff using a model driven PowerApp. It gives staff ready access to the data in a secure way. In addition, they get the power of AI assisted searching (like recognizing common abbreviations and acronyms), and this old data can be combined with new data in the Dataverse.
Old and new worlds collide with Data Factory and the Dataverse to create the one thing we all are searching for – one complete view of corporate data.
Across the Industry
View live images from NASA’s Double Asteroid Redirection Test (DART)’s collision with the asteroid Dimorphos
The federal government’s centralisation of networks continues in a pilot program
Dealing with security and sustainability issues in hard drive disposal
Read about Matter, an attempt to standardise requirements for the Internet of Things (IoT)
Forrester predicts AI spending to reach $64 billion by 2025
Australia Post utilises multiple clouds to reduce costs
Recent Government Tenders
City of Port Adelaide Enfield: Facilities Hire Booking System (Consolidated Tenders)
Department of Justice and Community Safety: Provision of Early Injury Intervention Service (EIIS) (Buying For Victoria)
Mitchell Shire Council: Risk and OHS Management System (eProcure)
Bass Coast Shire Council: ICT Managed Services (eTenderBox)
Microsoft News
Join industry leaders in a range of learning and networking events at Microsoft Ignite, running from 12-14th October
Read about how banks and financial services providers are reaching net zero
No Comments
Leave a comment Cancel