Big Data Consulting Services

We help you harness the power fo your data

WHISHWORKS’ team of technical architects and data engineers will help your organisation collect, store, enrich and transform data from disparate sources into actionable insights and business intelligence. 

50+

Global
Implementations

40000

+

Implementation

Hours

300

+

Clusters Built

50

+

Big Data

Certifications

70

+

Hadoop & Partner
Components Experience

The value of information technology has drifted away from hardware and software, to data. Data in this digital age brings in challenges in terms of connectivity, scale, speed and complexity. Our big data experts with proven methodologies, will work with you to understand the underlying business needs and dynamics, assess your systems and define the capabilities needed to make your data initiatives a success.

Our team evangelises value streams aligning to business goals, and implementation road maps for use cases aligning to your near term and long term objectives. Our proven agile delivery model ensures key milestones and timelines are met, and minimum viable products are delivered in each sprint. Our architecture design is overseen by our Big Data Centre of Excellence, and includes gap analysis, readiness assessment and the development of a technology blueprint.

Our Big Data Consulting Services

In most organisations the key business objectives are outlined but not necessarily the scope of the Big Data initiative. Our discovery service helps you to create a broader scope for the initiative, a minimum viable product, an optimal solution and the shortest path to achieve your objectives.

What we do

Our big data consultants will carry out the following set of activities on-site or remotely in collaboration with your team, though some of these could vary based on the nature of engagement: 

  • Plan and schedule business workshops, stakeholder interviews and technical reviews to scope project requirements.
  • Conduct workshops to discuss data source systems, data integration and quality standards, data extraction methodologies and interfaces.
  • Document user stories, architectural and non-functional requirements.
  • Architect and implement a proof of concept.
  • Review architecture, user stories and programme plans - amend and finalise.
  • Present product backlog, technical architecture document and roadmap. Finally, draft and agree to the next steps.

What we deliver

Once the service is completed, WHISHWORKS' consultants will provide you with the following artefacts:

  • An initial project charter document detailing objectives and scope.
  • A draft project plan containing an initial schedule and an estimate of required effort for its implementation.
  • A high-level technical architecture document detailing recommendations for the architecture needed to support the proposed solution.
  • A high-level user story backlog describing an agreed understanding of requirements.

Timeline

The duration will vary in line with the needs of a particular engagement, most discovery service exercises take around thirty days, amounting to four to six weeks of elapsed time. Typically, the main workshops are conducted during the first two weeks and following that, the deliverables are created.

Next Steps

Once you have the right project road map and solution architecture the logical next steps are to proceed
with platform set up, data integration and analytics

You are ready to solve the big data problem but not sure of what would be the right architecture, platform and tools to use. To build a robust data management and analytics platform, the first and most important step is to have the right foundations, i.e, clear cut business requirements, meticulous understanding of workload, security and capacity. Secondly, the platform has to support data and analytics at scale.

With our experience in building systems to handle petabytes of data and scale it to hundreds of nodes, you will be confident that the desired form and function are going to be met.

What we do

Our big data consultants will carry out the following set of activities, on-site or remotely, in collaboration with your team, though some of these could vary based on the nature of engagement: 

  • Architect and design the platform as per the application, infrastructure and security requirements.
  • Size and plan the platform capacity based on historical and future data volumes and workload.
  • Work closely with the application, infrastructure and network teams, to understand the platform requirements from a technology standpoint and ensure conformance to standards.
  • Understand your security, governance and data standards and design the cluster security based on the core security standards and industry compliances.
  • Platform installation with all required components as per the design.
  • Implementation of required security configurations as per your standards.
  • Toolset installation to ensure constant monitoring and proactive alerting.

What we deliver

Once the service is completed, WHISHWORKS' consultants will provide you with the following artefacts:

  • Fully functional and secured data management platform conforming to your organisational standards.
  • An operational guide and runbook with detailed information on day-to-day cluster management.
  • Knowledge transfer on cluster operations and management.

Timeline

The duration will vary in line with the needs of a particular engagement. Most platform architecture and build service exercises take around thirty days, amounting to four to six weeks of elapsed time. Typically, the cluster design is done during the first two weeks and following that, the infrastructure is set up.

Next Steps

Once you have designed and built the right platform, the logical next step is to proceed with data integration and analytics.

Analysing data stored in silos has limited value. With an integrated data lake, you can unlock insights that would have otherwise been missed. WHISHWORKS provides a unified solution for Data Integration: building, deploying, and managing real-time data-centric architectures in a big data environment. Once the big data platform is setup, our data integration services aim to achieve multiple elements of data integration, like batch and real-time data ingestion, from identified data sources. The data transformation, data verification and quality activities ensure that information available is up to date, accurate, and consistent across systems.

What we do

Our big data consultants will carry out the following set of activities on-site or remotely in collaboration with your team, though some of these could vary based on the nature of engagement 

  • Plan and schedule business workshops, stakeholder interviews, and technical reviews to scope data ingestion, transformation and quality management requirements.
  • Conduct workshops to discuss and understand data source systems, data consuming platforms, data formats, data mappings, business rules, data transformation, data quality, data extraction methods and interfaces.
  • Understand and document non-functional requirements like data volume and throughput.
  • Design key data processing frameworks/engines required for the implementation.
  • Design detailed technical architecture and ensure adherence of end-to-end data lifecycle.
  • Implement an end-to-end data integration solution based on the approved technical architecture.
  • Perform unit, functional and performance testing to ensure business and non-functional requirements are met.

What we deliver

During the course of this service, WHISHWORKS consultants will provide you with the following artefacts:

  • Detailed design document including functional and non-functional requirements, solution architecture and technical architecture.
  • Project Implementation plan with breakdown of work structure and activities required for providing this service.
  • Technical artifacts like code, build scripts and unit tests, project documentation like operational guide and deployment guide.
  • Functional and performance test reports.
  • Weekly project progress reports.

Timeline

The duration will vary in line with the needs of a particular engagement, most data integration service exercises with around two data source and two data consuming platforms take around twelve to sixteen weeks of elapsed time. Typically the main workshops are conducted during the first two weeks and following that, the deliverables are created. 

Next Steps 

Once you have the right data integration solution, the logical next steps is to proceed with data analytics.

WHISHWORKS will review your current Big Data ecosystem to provide observations and recommendations to better leverage your existing clusters. Our consultants will evaluate your existing big data solution from platform, solution and technical architecture stand point to help ensure your solution cater to both present and future data and analytics requirements.

What we do

Our big data consultants will carry out the following set of activities on-site or remotely in collaboration with your team, though some of these could vary based on the nature of engagement: 

  • Review the architecture and application design from a best practices adherence perspective.
  • Review ongoing issues, bottlenecks and platform constraints, and recommend optimal solutions.
  • Assess platform topology on storage, infrastructure & cluster architecture.
  • Review data ingestion, access and processing workloads.
  • Assess strategies for data management, data ingestion and third-party applications.
  • Assess governance standards, security solution, security configurations and encryption standards.
  • Understand and optimise software lifecycle and release automation processes.
  • Assess OS and platform hardening strategies and provide recommendations.
  • Assess disaster recovery & backup strategies and provide recommendations.
  • Review product roadmaps and strategise upgrade options.

 What we deliver

During the course of this service, WHISHWORKS consultants will provide you with the following artifacts:

  • Detailed assessment report with observations and recommendations based on WHISHWORKS technology expertise and industry best-practices.

Timeline

The duration will vary in line with the needs of a particular engagement, most architecture assessment service exercises take around thirty days, amounting to four to six weeks of elapsed time. Typically the assessment is done during the first four weeks and following that, the assessment review and recommendations report is created.

AIMIA

Big Data | Hortonworks AWS | Loyalty Analytics

AIMIA is a loyalty analytics company which provides various loyalty management programs to its clients. WHISHWORKS integrated their in-house and third party systems using dynamic scaling, to help them handle their growing data load and analyse point-of-sale data.

View Case Study

Payment Processor

Data Lake | Hortonworks | Event Search

The customer are a leading payments processing services provider. WHISHWORKS helped them implement an enterprise-wide data lake, improve their data analytics and optimisation capabilities, and build solutions to cater for integrated payments.

View Case Study

Our Big Data Partners


For the best in security, reliability, real-time performance, and reporting for open data platforms and applications, our Big Data partners are the power behind the world’s data economy.

Hortonworks
MapR Technologies
cloudera
databricks
qlik-logo-2x-teeny.png
dataguise.png
Mulesoft
Hortonworks
MapR Technologies
Qlik
Cloudera
Databricks