XML Data Pipelining Platform

PolarLake’s patented Data Pipelining Platform is used by over 50 organizations across buy side, sell side, fund administration, telecommunication and government sector clients.

It is a unique technology focused on the streaming of data for use in highly complex data distribution and integration applications. It splits large documents / messages into multiple fragments for parallel processing resulting in dramatic improvements in speed of data delivery.  For example a client loads all of the Bloomberg back office files in 22 minutes where a legacy application took 9 hours.

The XML Data Pipelining Platform allows for massive improvements in performance of large scale data distribution.  For example a recent client engagement allowed the import of terabytes of bulk Reference Data accelerating the process from hours with an existing legacy application to minutes with PolarLake. 

The Data Pipelining Platform is also the core technology which allows PolarLake to build domain specific, business focused applications in the areas of Pricing and Reference Data Distribution.

The Data Pipelining Platform is used by IT organizations and technical operations support teams to:

• Deliver high performance batch and real time data distribution in run time enabling IT teams to meet data deliver SLAs confidently
• Permit all data formats to be treated as XML allowing for the use of XML technologies (XPath, XQuery) and enabling the abstraction of data mapping, resulting in much faster development, in some cases up to 4 times faster
• Provide a full set of connectors for multiple transport protocols (HTTP,FILE, , MQ, JMS, EMS, FTP, RDBMS etc.) giving flexibility and out of the box connectivity
• Enable implementation of standard SOA patterns (web services etc.) in a technology capable of large scale batch / ETL type processes as well as real time updates and request reply mode of operation. This provides flexibility and enables responsiveness to meet changing business needs. For example enabling a trader to start trading a security by prioritizing issuer set up instead of all other distributions.

The PolarLake Data Pipelining Platform begins processing the start of a document while it has not yet received the end of the document. The Platform has the ability to process Data formats including (CSV, XML, SWIFT, FIX, FpML etc.) while treating them all as if they were XML using a PolarLake technology known as XML virtualization. All connectivity for PolarLake applications to different protocols, such as HTTP, FILE, MQ, JMS, EMS, FTP, RDBMS etc. are provided by the Data Pipelining Platform. The behaviour of Data Pipelines is controlled by circuits which allow the user to define the data workflow and path of data through a pipeline.

For more information

info@polarlake.com