Whilst working at a Water Corporation a while back, I had to migrate 250k records from Records Manager toย Content Manager 9. The documents themselves were straightforward, but the transformations of the related metadata were extreme (including nested lists). I used Power Query for this and although good for understanding data quality, it was very manual and would hang on large datasets.
Finding a good and cost effectiveย ETL (Extract, Transform and Load)ย platform is difficult, particularly something that is corporate grade. You maybe familiar withย FME Workbenchย – particularly those of you that look after GIS. Itโs a great tool but expensive. Youโll be pleased to know that there is a cloud based Microsoft equivalent –ย Azure Data Factory.
We are using Data Factory to pull data from a data warehouse (containing legacy ERP data), perform some minor transformations, and then push it into theย Dataverse. The data is then made available to staff using a model driven PowerApp. It gives staff ready access to the data in a secure way. In addition, they get theย power of AI assisted searchingย (like recognizing common abbreviations and acronyms), and this old data can be combined with new data in the Dataverse.
Old and new worlds collide with Data Factory and the Dataverse to create the one thing we all are searching for – one complete view of corporate data.
Across the Industry
View live images from NASA’s Double Asteroid Redirection Test (DART)โsย collision with the asteroid Dimorphos
Theย federal governmentโs centralisation of networksย continues in a pilot program
Dealing withย security and sustainability issues in hard drive disposal
Read about Matter, an attempt toย standardise requirements for the Internet of Things (IoT)
Forrester predictsย AI spending to reach $64 billion by 2025
Australia Post utilises multiple cloudsย to reduce costs
Recent Government Tenders
City of Port Adelaide Enfield:ย Facilities Hire Booking Systemย (Consolidated Tenders)
Department of Justice and Community Safety:ย Provision of Early Injury Intervention Service (EIIS)ย (Buying For Victoria)
Mitchell Shire Council:ย Risk and OHS Management Systemย (eProcure)
Bass Coast Shire Council:ย ICT Managed Servicesย (eTenderBox)
Microsoft News
Join industry leaders in a range of learning and networking events atย Microsoft Ignite, running from 12-14th October
Read about howย banks and financial services providers are reaching net zero
No Comments
Leave a comment Cancel