STORAGE

STORAGE


Pacific Teck offers three parallel file system storage software products:

 

BeeGFS by ThinkParQ

BeeGFS

Why use BeeGFS?

BeeGFS transparently spreads user data across multiple servers. By increasing the number of servers and disks in the system, you can simply scale performance and capacity of the file system to the level that you need, seamlessly from small clusters up to enterprise-class systems with thousands of nodes.

 

Get the Most Out Of Your Data

The flexibility, robustness, and outstanding performance of BeeGFS help our customers around the globe to increase productivity by delivering results faster and by enabling new data analysis methods that were not possible without the advantages of BeeGFS.

 

Enterprise Level Support

Pacific Teck is the official Platinum ThinkParQ Partner in Asia. Installation & Support is offered entirely by Pacific Teck and through our partner SIs. We have experience in installing BeeGFS at some of the largest sites in Asia, and work back to back with ThinkParQ for source code level fixes.

 

Enterprise Level Support

Pacific Teck is the official Platinum ThinkParQ Partner in Asia. Installation & Support is offered entirely by Pacific Teck and through our partner SIs. We have experience in installing BeeGFS at some of the largest sites in Asia, and work back to back with ThinkParQ for source code level fixes.

 
BeeGFS

 

Maximum Scalability

BeeGFS offers maximum performance and scalability on various levels. It supports distributed file contents with flexible striping across the storage servers on a by file or by directory base as well as distributed metadata.

BeeGFS is optimized especially for use in environments where performance matters to provide:
Best in class client throughput: 8 GB/s with only a single process streaming on a 100GBit network, while a few streams can fully saturate the network.

Best in class metadata performance: Linear scalability through dynamic metadata namespace partitioning.
Best in class storage throughput: BeeGFS servers allow flexible choice of underlying file system to perfectly fit the given storage hardware.

 

Maximum Flexibility

BeeGFS supports a wide range of Linux distributions such as RHEL/Fedora, SLES/OpenSuse or Debian/Ubuntu as well as a wide range of Linux kernels from ancient 2.6.18 up to the latest vanilla.

The storage services run on top of an existing local filesystem (such as xfs, zfs or others) using the normal POSIX interface and clients and servers can be added to an existing system without downtime.

BeeGFS supports multiple networks and dynamic failover in case one of the network connections is down.

 

Scientific Computing

BeeGFS is widely popular among universities and the global research community, powering some of the fastest supercomputers in the world to help scientists analyze large amounts of data efficiently every day.

 

Life Sciences

BeeGFS is the parallel file system of choice in life sciences. The fast growing amount of genomics data to store and analyze quickly in fields like Precision Medicine make BeeGFS the first choice for our customers.

 

Finance, Oil & Gas, Media, Automotive and other markets

BeeGFS is used in many different industries all around the globe to provide fast access to storage systems of all kinds and sizes, from small scale up to enterprise-class systems with thousands of hosts.

Start Your Free Trial

Download Datasheet

Download Whitepaper

 

See Case Studies About BeeGFS

See News About BeeGFS

 

Pacific Teck was Awarded Platinum Status for BeeGFS

 


 

BeeOND by ThinkParQ

BeeOND

What is BeeOND?

BeeOND stands for BeeGFS on Demand, and is a complementary product to BeeGFS but can be used with other file systems as well. It is typically used to aggregate the performance and capacity of internal SSDs or hard disks in compute nodes for the duration of a compute job. This provides additional performance and a very elegant way of burst buffering. The way it works is to create one or multiple instances of BeeGFS on these compute nodes that can be created and destroyed “on-demand.”

 

BeeOND on Compute Nodes

 BeeOND on Compute Nodes

 

Why use BeeOND?

Modern compute nodes are often rich in SSDs and NVMe that are under utilized. By grouping unused high-speed resources together, a space is created where users can process some or all of their data much faster than on the standard hard disk based file system.

The main advantages of the typical BeeOND use-case on compute nodes are:

  • A very easy way to remove I/O load and possibly nasty I/O patterns from your persistent global file system. Temporary data created during the job runtime will never need to be moved to your global persistent file system, anyways. But even the data that should be preserved after the job end might be better stored to a BeeOND instance initially and then at the end can be copied to the persistent global storage completely sequentially in large chunks for maximum bandwidth.
  • Applications that run on BeeOND do not “disturb” other users of the global parallel file system and in turn also got the performance of the BeeOND drives exclusively for themselfes without any influence by other users.
  • Applications can complete faster, because with BeeOND, they can be running on SSDs (or maybe even a RAM-disk), while they might only be running on spinning disks on your normal persistent global file system. Combining the SSDs of multiple compute nodes not only gets you to high bandwith easily, it also gets you to a system that can handle very high IOPS.
  • BeeOND does not add any costs for new servers, because you are simply using the compute nodes that you already have.
  • You are turning the internal compute node drives, which might otherwise be useless for many distributed applications, into a shared parallel file system, which can easily be used for distributed applications.
  • You get an easy chance to benefit from BeeGFS, even though your persistent global file system might not be based on BeeGFS.

 

Get the most out of your SSDs

BeeOND uses existing NVMes and SSDs in the system, even space from SSDs shared with the OS. Many competitive burst buffer solutions require purchasing a new layer of expensive hardware, but BeeOND uses resources that already exist.

 

Enterprise Level Support

Pacific Teck is the official ThinkParQ Platinum Partner in Asia. Installation & Support is offered entirely by Pacific Teck and through our partner SIs. We have experience with the largest sites in Asia, and work back to back with ThinkParQ for source code level fixes. We recommend pairing with enterprise supported Univa Grid Engine.

 

Minimize I/O Problems

A very easy way to remove I/O load and possibly nasty I/O patterns from your persistent global file system. Temporary data created during the job runtime will never need to be moved to your global persistent file system, anyways. But even the data that should be preserved after the job end might be better stored to a BeeOND instance initially and then at the end can be copied to the persistent global storage completely sequentially in large chunks for maximum bandwidth.

 

Maximize IOPS

Applications can complete faster, because with BeeOND, they can be running on SSDs (or maybe even a RAM-disk), while they might only be running on spinning disks on your normal persistent global file system. Combining the SSDs of multiple compute nodes not only gets you to high bandwidth easily, it also gets you to a system that can handle very high IOPS.

 

Machine Learning

Machine learning environments are often rich in NVMe resources for BeeOND to utilize. In Japan, Univa Grid Engine and BeeGFS/BeeOND are integrated at TiTech (540 Nodes with 4 P100 and 4 OPA HFIs per node ) and ABCI (1088 Nodes with 4 V100 and 2 EDR ports per node). Univa Grid Engine kicks off BeeOND and tells it how many NVMe to use, when to use it, and what to do after the job finishes. This is really an on demand burst buffer using the NVMe contained in compute nodes.

 

Scientific Computing

BeeOND help scientific clusters around the world achieve burst buffer level performance increases without breaking the budget. Together with Univa Grid Engine, this rich resource using existing hardware can be fairly shared among groups and users.

Start Your Free Trial

 

See Case Studies About BeeOND

See News About BeeOND

 

Pacific Teck was Awarded Platinum Status for BeeGFS

 


 

Lustre by Whamcloud

Lustre

What is Lustre?

Lustre is a type of a parallel distributed file system used for large-scale cluster computing. Parallel file systems allow for processing of large files by multiple nodes at once.

 

Why use Lustre?

When properly tuned for performance, Lustre has fast performance. It is also fully open sourced with enterprise support options provided by Pacific Teck. Pacific Teck can provide local support with a back to back agreement with Intel, who can provide developer level fixes.

 

Get the most speed from your cluster

Don’t let storage be your bottle neck. As the compute side of the cluster gets more and more powerful, slow storage could prevent fully harnessing that performance. A high speed file system like Lustre, with a high speed interconnect like Omni-Path are critical elements to maximising cluster performance.

 

Maximize Speed

The drawback of Lustre is that it is not easy to install, tune and support. That is where Pacific Teck’s enterprise support adds value. Pacific Teck can analyze your cluster top to bottom and develop a custom build to get you started on the right foot. From there, we will work to make sure all settings, drivers, etc are working together properly to ensure maximum speed.

 

See Case Studies About Lustre

See News About Lustre