Categories
Data

MultiValue Databases Explained

MultiValue Databases Explained

If you recognise the names Don Nelson or Dick Pick – congratulations – you’re part of an exclusive club of experts who understand the power of MultiValue databases.

But if those names don’t ring a bell, you’re (still) in the right place, for you’re about to uncover why MultiValue databases are so popular today, more than 50 years on.

What is a MultiValue Database?

MultiValue database is a type of NoSQL and multidimensional database, often referred to as a Pick database – eponymously named after one of the lead developers: Richard A. (Dick) Pick. MultiValue databases are also known as NF2, non-first normal form systems.

In defining MultiValue database systems, it’s important to state what they aren’t: a conventional relational database. And while MultiValue systems share many similarities to relational databases, their schemas are less rigid. That means MultiValue databases can assign more than one value to a single attribute.

MultiValue databases are often categorised with MUMPS within the category of post-relational databases, despite the data model pre-dating the relational model. But unlike SQL-DBMS tools, most MultiValue databases can operate with or without SQL.

What are the Advantages of MultiValue Databases? 

The tabular structure of MultiValue databases allows multiple values for attributes whereas relational databases store one fact within a table cell. Everything possible in a relational database is possible in MultiValue, but with the added advantage of storing multi-dimensional data. The multiple value advantage of MultiValue is one of many reasons why they are a popular choice with large data sets typical in large enterprise and government.

Big data analytics tend to run faster and easier on MultiValue systems due to flexibility when dealing with complex data structures. MultiValue databases can manage certain data structures that conventional relational databases find complex. Decades of big data commonly found within large financial institutions and government agencies are why MultiValue databases offer inexpensive data solutions compared to relational database solutions.

MultiValue versus Relational Model 

The following diagram is a hospital’s application for controlling their ambulances. When modelling the call logging and dispatch elements using the relational model, the process equates to nine database tables with fifteen interdependencies.

Applying the same with the MultiValue model creates an application with just four database tables and six interdependencies. 

MultiValue’s simplicity offers efficiencies with economic advantage compared to the relational model. The complexity of the relational model results in higher development and maintenance costs with an increased risk probability of error.

Who are the MultiValue Vendors? 

  • Rocket U2 (UniVerse and UniData)
  • OpenInsight by Revelation
  • OpenQM by Ladybridge Systems
  • NPS Reality by Northgate-IS
  • Caché by InterSystems

MultiValue Superpowers and their Kryptonite

Many MultiValue database system developers will readily confess that accessing MultiValue data is a challenge – especially in real-time. Faced with disconnected information silos and the need to write dictionaries, all while maintaining application vendor support agreements are MultiValue shortcomings.

“You just can’t access the data” or “how to get to my MultiValue database information” is commonly heard across MultiValue database system users. The data is locked up in legacy data systems with limited support and data tools. 

Extracting meaningful and timely business intelligence has been the greatest challenge. Engaging relational thinking with MultiValue data has been the greatest challenge to date. Companies have tried with in-house developers or vendor promises to unlock MultiValue data. Most have yet to find a feasible solution that doesn’t require millions and months to accomplish.

MultiValue developers can’t simply rewrite the tools or analytics, and retraining of key staff isn’t an overnight solution that’s feasible for the now. All the tooling, visualisation and ways of conducting analysis across data is predominately written by developers who understand relational databases, writing for relational models.

The simplest way to achieve the desired outcome is to take MultiValue data and put it into a format that allows accessibility by those who need it.

The benefit of doing so means you won’t have to implement costly replacement or migration programs for your core systems. There’s no business disruption and you can extend the return on your investment in your systems. This gives you the ability to process and analyse your information in different ways that you couldn’t before.

How Do I Access My MultiValue Data?

With ARQ Fuse – a managed service that allows the data-impaired to see everything.

ARQ Fuse lifts the veil on dark data-impairment so you can say goodbye to your disconnected information silos. Unite your scattered data puddles into centralised data lakes with integrated data domains for on demand visibility across your entire organisation.

ARQ Fuse enables a single point of conformed data-truth with the confidence of governance for data-driven decisions at pace. Ask new data and analytic questions across your full data set and get answers in real-time, unlike never before.

ARQ Fuse works by applying non-MultiValue information governance and non-MultiValue data handling techniques to resolve the MultiValue paradigm. Normalising your MultiValue database is the secret sauce of our intellectual property that empowers you to choose any data analytical platform to gain fresh new insights from your MultiValue data.

Watch the 54 second video on how ARQ Fuse normalises your data:

Visit the ARQ Fuse page to learn how you can break free from the crawl of pace from traditional MultiValue systems and get real-time business intelligence dashboards, competitive advantage from digital transformation and the ability to migrate all your data to the cloud.

Steve McCormick

Chief Customer Architect

ARQ Group

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Data

Tailored Data Governance: Your Why and What Matters

Tailored Data Governance: Your Why and What Matters

Lawrence Eva, Principal Consultant, Data & Analytics

Data governance is a hot topic of discussion with ARQ’s customers and clients. Yet surprisingly, many conversations share a common theme: 

“With several attempts at data governance for our business, nothing seems to stick.” 

Data governance has become more important than ever. The amount of data being used in business is increasing exponentially. With data being used to drive critical business processes, governance still remains a challenge for many companies.

So why is data governance so hard to get right on the first attempt? 

As the ARQ Group’s Principal Consultant for Data and Analytics, I have seen many times data management teams spend months – if not years – writing slick policies and procedures covering every use case and scenario before trying to apply those policies to the business. 

The focus on every scenario can send data management teams down a rabbit hole, where timelines creep up on the team. This results in change management and embedding activities becoming squeezed. Many of the key players in the financial industry fell into this trap when regulatory pressure forced them to start data governance programs without fully tailoring said programs to the culture of the company or desired outcomes.

Rather than focus on the theory of data governance, perhaps focus on the application of data governance. Remember what you are implementing are rules and regulations – and like all rules and regulations – unless there’s clarity on the WHY, and your people accept and agree, pushback may ensue. This can sometimes amount to frustration, and worst case: rebellion (or at least non-compliance). 

Your WHY is key, but also needs to be balanced by WHAT you are implementing. By WHAT, the level of data governance (rules and regulations ) you’ll be implementing. If you’re implementing a complex set of stringent data governance policies, your WHY needs to be rock solid! 

Alternatively if your approach is to progressively implement a set of simple guidelines, your WHY can also be simple, and gain strength as the business enjoys positive results from your guidelines. 

Never has this balance been more evident as seen in the world’s handling of COVID 19. An initial strict lockdown in Australia was accepted because the WHY was so compelling – lockdown or face COVID19 spread like wildfire with deaths imminent. 

Would Australia have accepted a lockdown if the stakes were not so high? 

The initial WHY is so important, because it’s the point you’re asking people to comply with only the promise of favourable outcomes. As time progresses, if your data governance rollout is successful, your people will see evidence in the benefits of compliance, and likely to follow your policies and procedures. 

Again, we saw this behaviour in COVID19 – by December 2020, an entire lockdown of New South Wale’s Sydney Northern Beaches was accepted. The WHY was accepted during a peak social time (Christmas and New Years), because the results of non-compliance were evident in other countries who had not controlled their outbreaks (as well as Australia).

Getting back to your WHY. How are you going to convince all levels of your organisation that data governance needs to be implemented? 

Your first step is to align with the leaders of your organisation and understand why data governance is important to them. Sometimes this can be easy, where external factors such as regulatory pressure, are top of mind thoughts for the leadership team. At other times you will need to go through a number of possible benefits/drivers to understand what resonates. Benefits/Drivers could be:

  • Productivity – The business has a large workforce of people using data, often inefficiently and in a duplicative manner. Data governance can help streamline and ensure data is used and processed once for multiple uses, reducing overall costs
  • Alignment/Agreement – Different areas of the business may calculate key business metrics differently, which in turn could drive different business actions. Data governance can ensure that a CEO does not receive two conflicting versions of key information, and defines who is accountable in the business for that information
  • Value – Data may be underutilised in the business, perhaps by the accessibility or quality of data, and your business may not be extracting as much value as it could of, out of data driven initiatives
  • Regulatory/Audit as described previously

Once you’ve agreed the WHY with your senior leaders, be clear on the funding and sponsorship they are willing to provide to implement. Resonating is one thing, putting up the investment needed is another. 

Data Governance is not easy and requires hours of work, either from new resources the business will need to fund, or by adding work to resources who are already performing a full time job. When companies refer to failed data governance rollouts, many times this is the reason – companies spend the time to write the data governance policies and procedures, but don’t invest in the capacity for the people on the ground to follow the procedures of data governance, and the whole thing falls apart.

So now you have the WHY and the sponsorship, you can start to shape the WHAT.

Here the key is tailoring the WHAT to your companies specific WHY and funding (hint: here’s where a consulting company like ARQ can help). 

Having been through this process multiple times, we know that if your key WHY is productivity and making data more accessible, a compliance heavy program centred around Collibra and requiring all data decisions to be made by a central data governance office is probably not the model that will engage your business. 

Conversely if the key WHY is being compliant with your regulators, a light touch governance process, focussing more on agility may not be the best model. Throw in other key factors such as the culture of your business (i.e are they a command based culture, where edicts from the top are largely followed, or is it more of a collaborative culture where employees are encouraged to innovate) and it is clear that tailoring a data governance solution for your company is the only way to go. 

Our work at the Australian Broadcasting Corporation (ABC) has started on this journey and very cognisant of the above factors, which we believe will lead to a successful rollout over the coming months and years.

If you want to talk data governance and not sure where to start, the ARQ Group can help.

I’m Lawrence Eva, Principal Consultant of Data & Analytics at ARQ Group. You can connect with me on LinkedIn and I’ll show you how to get started on a sensible, simply and low-risk approach to your data governance. 

Alternatively, visit our contact page and leave your details. We’ll get back to you with the quickness.

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Analytics Announcements Data

Arq Group first in Australia to attain AWS Data and Analytics Competency

Arq Group first in Australia to attain AWS Data and Analytics Competency

Arq Group

Arq Group

Arq Group first in Australia to attain AWS Data and Analytics Competency

Arq Group has been an AWS partner since 2012 & awarded the AWS Innovation Partner of the Year, 2018 for Asia Pacific and Australia/New Zealand

Arq Group
Arq Group has been an AWS partner since 2012 & awarded the AWS Innovation Partner of the Year, 2018 for Asia Pacific and Australia/New Zealand, and is listed as an AWS Premier Consulting Partner, an accreditation that highlights the top AWS Partner Network Consulting Partners. In addition, Arq Group was the first Australian MSP to gain AWS Mobile Competency status in April 2019. This highlights Arq Group’s rich history with AWS and its commitment to insight, partnership, and creative thinking.​

One of Australia’s leading digital solutions providers, Arq Group, has today announced it has been recognised with the Amazon Web Services (AWS) Data and Analytics Competency – the first Australian-based partner to have earned this accreditation. The achievement of this competency recognises that Arq Group continues to build Data and Analytics solutions that successfully enable its customers to utilise AWS tools, techniques, and technologies that drive business value.

This competency differentiates Arq Group within the AWS Partner Network (APN) in Australia, highlighting its passionate support of customers who want to create unforgettable experiences using Arq Group’s technical proficiency to seamlessly deliver data and analytics solutions. To be awarded this competency, partners in the APN network must demonstrate deep knowledge and expertise of AWS, and show deft skill to proficiently support customers to collect, store, govern, and analyse data at any scale.  Attaining this AWS Competency Status allows Arq Group to showcase its expertise in data and analytics, and adds to its existing strengths as an AWS Premier Consulting Partner, Managed Service Provider (MSP) Partner, Public Sector Partner, and its recognised competency in Mobile.

Tristan Sternson, Chief Executive Officer at Arq Group said, “Arq Group’s passion lies in helping customers harness the possibilities for smart design with data and technology. With the future of customer experience relying increasingly on hyper-personalised experiences that place the customer at the centre, the data organisations hold and have access to is a powerful tool to derive insights that can address business challenges and solve real world problems.

We are incredibly proud to be the first Australian partner to be recognised with the AWS Data and Analytics Competency. The awarding of this competency is further proof of Arq Group’s ability to enable and inspire our customers on their journey toward using the power of data. This achievement is evidence of Arq Group’s leadership in the delivery of cloud-based solutions that are scalable, cost-effective, and secure, and that address the reality of an increasingly customer centric world.”
Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Analytics Announcements Data

Arq Group accelerates data capability as it welcomes Informatica to its partner portfolio

Arq Group accelerates data capability as it welcomes Informatica to its partner portfolio

Dean Didan

Dean Didan

Arq Group accelerates data capability as it welcomes Informatica to its partner portfolio

Arq Group has partnered with enterprise cloud data management provider, Informatica, to expand its data capabilities and empower customers to make smarter and more informed data-driven decisions

Arq Group

The partnership with Informatica, which is a leader in 5 of Gartner’s Magic Quadrants, will provide a platform for Arq Group to elevate its current suite of data and analytics solutions and enable customers to improve decision making and respond rapidly to business changes.  

Transformation is at the fingertips of organisations that can harness their data. We’re thrilled that our partnership with Informatica will enable our customers to maximise their business insights and leverage it to apply meaningful and actionable outcomes,” says Cameron Boog, Executive Director of Digital Technologies.  

Arq Group customers will benefit from the latest developments in data technology, led by Informatica’s eight R&D hubs around the world. Meanwhile, the partnership will also support the professional development of Arq Group employees, who will receive exclusive access to training, sales, and marketing resources.  

The partnership with Informatica is one of a handful of strategic partnerships Arq Group is committed to bringing its customers. Informatica will join the ranks of Google, AWS, IBM, Adobe, Snowflake and Salesforce, who all partner with Arq Group to deliver best-in-class technology products and services to customers across Australia.  

By joining forces with Informatica, not only can will we build on the strength of our current data and analytics offering for our clients, but we can accelerate the business potential for customers across Australia,” adds Mr Boog.   

As we continue to grow our partner ecosystem, we are excited to welcome one of the top AWS data and AI partners, Arq Group, to the informatica family,” says Nick Smith, Managing Director, informatica.

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Analytics Data Events

Workshops unlock the power of data and analytics

Workshops unlock the power of data and analytics

Oliver

Oliver

Workshops unlock the power of data and analytics

Maryna Tyshchenko knew that the world of data and analytics had the potential to unlock new opportunities and progress her career. So, when the opportunity came along to delve deeper and learn new skills, the Sydney-based Human Resources Assistant jumped at the chance. She signed up for several workshops and events co-hosted by Arq Group and She Loves Data, and since then she hasn’t looked back.

Author

Arq Group and She Loves Data unlock the power of data and analytics

When Arq teamed up with She Loves Data in 2019, we had no idea that the partnership would prove so successful. As a Work180 endorsed employer for women, Arq’s mission is to create partnerships that help drive our commitment to gender equity in the workplace.

Throughout 2019, more than 1,000 women attended the workshops, networking events and coaching sessions that helped debunk myths, challenge stereotypes and unveil the powerful nature of data.

The Introduction to Data Analytics Workshop introduced participants to the logical thinking behind data and analytics and business intelligence, while the other highly successful She Loves Data workshops, such as Tableu Data Storytelling, illustrated how data can be used to tell a compelling story and guide decision-making. In other words, data shouldn’t be feared but revered!

“Our hope was to inspire a new generation of women to pursue careers in data, a traditionally male-dominated area. We were proud to support a tribe of close to 1,000 women as they navigated the fascinating world of tech. Our workshops and meet-ups were dynamic forums where data novices of all generations could learn new skills,” said Arq’s Diversity & Inclusion Manager, Samantha Trewick.

Throughout 2019 Maryna participated in the She Loves Data Tableau Data Storytelling, Introduction to Data Analytics, Introduction to Python Programming for Data workshops and mingled with like-minded women at the Data is the New Black meetup event.

“What I loved about the She Loves Data workshops was that women with all levels of experience were welcomed. It didn’t matter if you were new to the data world or you were a professional data analyst, everyone could find useful information, make new professional connections and meet fabulous and inspiring people from data and other fields.

“One of my favourite events was the Tableau Data Storytelling workshop with the amazing Cynthia Halim hosted by Arq Group. I learned a lot about data, become more confident in my ability to use technology and data analytics tools/programming languages such as Tableau, SQL, Python and I started to think critically.

“I believe that the knowledge what I gained with ‘She Loves Data’ will help me to progress my career to HR Analytics in the future,” Maryna said.

It wasn’t all about the hard data. To round out their skills, three workshops, held in collaboration with Tableau and Yellowfin, focused on developing participants’ presentation skills, critical thinking, communication skills and personal brand.

As a proud WGEA pay equity ambassador, Arq is passionate about supporting and encouraging women and we’re committed to closing the gender pay gap.

 

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Analytics Case Studies Data

Belong: Data Transformation

Belong

Data Transformation and Change Management

Project Background

In 2017, Belong identified the need to modernise their entire data stack, in support of their strong growth.

Building a new Data platform

Solution

 Arq developed an AWS technology roadmap demonstrating how the Belong technology landscape could evolve to meet developing business needs, taking advantage of AWS’ world-class functionality, scalability, performance and TCO in Data and Analytics

In parallel to the technology transformation, we also supported their move to a DevOps culture, which underpinned a shift in velocity, accuracy and security

The Outcome

With the technology transformation under way, Arq could now focus on helping Belong improve their reporting and analytics processes and tools.

Leveraging Talend, Redshift, Tableau, and several additional AWS products and services, we built out the supporting stack while simultaneously introducing an advanced governance structure designed to enhance the flow of information through the organisation.

The adoption of agile practices resulted in an almost immediate uplift in improved business decision making.

Categories
Analytics Announcements Data Professional Services

We’re included in Gartner Market Guide for Data & Analytics Service Provider

We’re included in Gartner Market Guide for Data & Analytics Service Provider

Dean Didan

Dean Didan

We’re included in Gartner Market Guide for Data & Analytics Service Provider

Infoready, Part of Arq Group, is proud to have been included in the recently released Gartner Market Guide for Data and Analytics Service Providers in the Asia Pacific.

Arq Group

Infoready’s inclusion in this report is a testament to the breadth of our service offering and our strong track record of helping our customers achieve success using insights gained through our data and analytics services.

Providing expert data engineering and data science services to some of Australia’s leading brands, we help our clients discover new business opportunities by providing deep insights into customer behaviour and business operations.

According to Executive Director of Infoready Justin Parcell, Infoready’s inclusion in the Gartner Market Guide is ‘reflective of our reputation as a market leader in data and analytics solutions for enterprise and government’.

Infoready is part of Arq Group, a leading provider of digital solutions for enterprise and government.

Infoready’s data and analytics expertise complements Melbourne IT’s cloud, managed services, and mobile capabilities, enabling rapid, design-led innovation and continuous improvement, and helping businesses better understand their customers’ needs.

Peter Wright, Managing Director Melbourne IT Enterprise, said that Infoready’s data and analytics capabilities ‘are a key part of Melbourne IT’s end to end service offering, facilitating improved engagement throughout the customer journey, and allowing businesses to continually grow and improve.’

About the Gartner Reports

Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore

Categories
Announcements Cloud Data

Arq Group Joins the AWS Public Sector Partner Program

Arq Group Joins the AWS Public Sector Partner Program

Oliver

Oliver

Arq Group Joins the AWS Public Sector Partner Program

Arq Group (formerly Melbourne IT Group), an Amazon Web Services (AWS) Premier Consulting Partner, is proud to confirm today’s announcement of their inclusion into the AWS Public Sector Partner Program.

Arq Group

The AWS Public Sector Partner Program recognises partners with solutions and experience in delivering for government, education and non-profit customers around the world. Arq Group qualified for the Public Sector Partner Program by demonstrating a track record of leadership in their approach to support these customers.


This latest development builds on a strong existing alliance between Arq Group and AWS. In August 2015, Arq Group was the first AWS Premier Consulting Partner in Australia to achieve the AWS Managed Services Partner status. The AWS Managed Service Program is designed for Amazon Partner Network (APN) Consulting Partners skilled in cloud infrastructure and application migration.
Together, Arq Group and AWS provide a complete cloud service and cloud management portfolio that gives government and enterprise customers fast, flexible access to the cloud. Arq Group’s demonstrated leadership in innovation and commitment to its partnership with AWS gives our customers continued confidence in protecting their data in the cloud or on any infrastructure.

Share on facebook
Share this on Facebook
Share on twitter
Tweet this
Share on linkedin
Share this on Linkedin

More to explore