Catch Me If You Can – Data Matching

Data matching compares two sets of the collected data and is usually based on various programmed loops and algorithms running it. It is done to discard the duplicate data and aid in better search results. It gives you a rich user experience and provides you with data cleansing, profiling, matching and data DE-duplication. This technique has made it very simple for the various organizations to share information across different departments. This tool is famous for its use in the Government organizations, where they have to keep a check for frauds in order to keep the public money safe. In a commercial setting this software can be used to identify and keep a record of the shopping habits of the customers in order to build a better relationship with them. So, basically the ultimate aim of this is to regulate and optimize accuracy levels across every area of an organization.

The Data matching software does record linking, object identification and entity resolution. It finds connections between data elements. For instance name and address, the software rapidly removes all the duplicate entries from the database. The powerful matching engine identifies the linked records based on similarities or similar records that contain keyboard errors, or missing words, additional words, nicknames or name variations in different cultures. In the worst case scenario, every record in a database is to be compared to all the other records on the other database. Such tasks are computationally expensive and tough to be accomplished in feasible time.

The benefits of matching data are many, as it helps improves working, efficiency and reduces time spent in manually DE-duping or DE-duplicating contacts. This increases the database reliability and integrity by warranting the accuracy of the data. It also combines data from the number of distinct dissimilar sources. All the records are combined into one error-less record within the database in real time. This improves the customer management with complete views across various departments and databases. It also enables data-driven business decisions by means of better profiling capabilities of customers. It also improves business intelligence with data accuracy.

It has been seen that based on Global Data Quality Research 2016, 90 per cent of the financial institutions consider ever-increasing policies have driven the call for improved data analytic and management. 99 per cent marketers want to convert data to insight. Inaccurate data is undermining the ability to provide an excellent experience as found by 76 per cent of financial institutions. The process of matching data can be done in batches as well as real time. It can be done ad hoc when required. It can match records created instantly and determines if it is a duplicate. It eliminated typos, nick names, suffixes or acronyms and works on sophisticated name matching. Its usage has been found in e-commerce, business mailing lists, computing, healthcare, online fraud detection, and National census. Even though matching data have its challenges and complications as data comes from different sources, formats, age, errors, as well as unpredictability.

Posted in Uncategorized | Comments Off

Think You Have Cloud Data Protection? You Need an MSP More Than Anyone!

Sounds crazy, right? Almost all our clients have a hard time believing that statement the first time they hear it. Since they have trusted all of their critical IT applications to the Cloud, they believe cloud data protection is just part of their package: that “someone” is watching over their applications to ensure they run perfectly and safely.

Unfortunately, that’s 100% totally wrong. In fact, this belief in automatic data protection in the cloud can and will bite you harder than you can imagine.

The Data Protection You Really Get

Here’s an example. Recently, I took a call from a prospect about managed services, and after we talked for a little while, I asked about his business continuity process. He assured me everything was handled by his various cloud providers and his data was safe. I replied, “Call one of them and ask specifically about data backup.” He was curious enough and said he would.

A few hours later, I got a call and the prospect was in a bit of a panic. His Cloud provider said that backup services were not included in his package, but they could add cloud data protection. The vendors follow up question was “Who is going to be the point of contact to get error messages and verify the backup was working?”

My prospect was stunned. He explained to the Cloud provider he assumed they would be the point of contact. Of course, they said no. Their business provided the service and he needed someone responsible to check whether the backups were in place and verify whether the cloud data protection was working according to his needs. The Cloud provider offered cloud capabilities that could solve his IT needs, but did not offer a service that verified everything was working and he was properly protected.

Imagine my prospect’s surprise at thinking his data was safe, when in fact it was not. He was very upset at the Cloud provider for not informing him sooner. They had assumed he knew what he was ordering. The level of cloud data protection he was receiving was clearly spelled out in his contract. My prospect quickly understood no one was watching over his critical data and processes. He was on his own.

Backup Rarely Comes Standard

Unfortunately, the situation got worse for my prospect. I also explained that his features in Office365 was a great system, but he should have someone managing his backup for email. My prospect responded with “But surely Microsoft can recover email forever. It’s just Exchange in the Cloud and their cloud is huge… ” I said yes, but even Office 365 has limitations and if he was not aware of those limitations, he could easily have issues recreating critical data.

Plus, Exchange in the cloud still needed someone to setup email addresses, control security, help with desktop applications, etc. Again, moving the technology to the cloud did not remove the need for a person to constantly manage the application. The cloud was definitely a better delivery mechanism, but people still had to be involved.

Who Handles Cloud Data Protection & Backups

The Cloud is a great technology and our clients use it every minute of the day, but as with all technology, the Cloud needs proper care and nurturing. Without such attention you will lose data and business productivity, the same as if your technology was onsite.

That is the value of a managed service provider.

We at KME Systems have the insight into what cloud vendors provide in their services and the expertise to provide to deliver excellent support while mitigating risks. As your IT services partner, we’ll provide you with cloud data protection and backup services that allow you to run your business without interruption.

Posted in Uncategorized | Comments Off

Hybrid Cloud Storage: A Tiered Approach

Hybrid Cloud Storage

For hybrid cloud storage, data mostly resides within the private portion of the cloud. If apps are also deployed within the private cloud, the data store may store files and data for these apps, this should be the highest-performing storage system within your entire hybrid cloud storage strategy.

It’s all about time and money

The costs of local and cloud data persistence is now so inexpensive that using secondary means, even tertiary mean, of storing data as an active backup system for primary persistence, or even as an up-to-date copy of the primary storage, is the best approach. With a few exceptions.

In the hybrid cloud storage strategy, the secondary storage system exists in the public cloud. Data is replicated or moved to a public cloud storage system, my preference is as Amazon Web Services’ (AWS) Simple Storage Service, to provide active backup for the primary storage system. In other cases, an enterprise might move older data to the public cloud to free up space in primary storage. AWS Glacier would be a great example.

If a secondary storage system is used to store data moved from primary storage, be sure to design your apps to look for data in both storage systems.

Triple up

Archived storage is optional, but triple redundancy is always a good idea. Again, and especially, with the low cost of storage. So why not? Archived storage systems are low-cost and low-performance systems designed for long-term storage of data that is no longer needed by core business processes, or to back up other backup systems. AWS Glacier, for example, is built for archival storage functions. In my industry, track/trace/serialization of Pharmaceutical products, it is mandated to archive data for six years.

Hybrid Cloud and Tiered Storage

Using a hybrid cloud for a tiered data storage architecture offers several benefits to an enterprise. First, because it establishes two, even three, separate storage systems all at different price and performance levels. Second, tiered storage helps developers and IT create application-specific storage strategies. For example, some data analytics systems interact almost exclusively with the most current data. As a result, an organization could move older data into a cheaper systems.

Additionally, tiered storage in the cloud creates a backup environment that spans two separate platforms — public and private cloud — to provide automatic redundancy that is geographically separate. Finally, tiered storage in hybrid cloud should reduce the risk of data loss, caused by disk failure or human error, to almost zero.

The challenge, however, is to create a tiered storage strategy that accounts for all enterprise use cases and properly serves business processes. For instance, in data analytics, the system might need to support other use cases, such as fraud detection through machine learning.

Enterprises must carefully design and plan for both their tiered storage architecture and automation processes. As with anything, test, test, test to ensure your hybrid tiered storage system lives meets requirements and expectations.

As always – Stay Cloudy

Hybrid Cloud storage is rapidly gaining ground because of market choices and ultra affordability. There are no longer excuses to put this off any longer.

Posted in Uncategorized | Comments Off