Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

How to manage massive file transfers

FTP falls out of fashion

Article comments

Despite being insecure and outdated, the file transfer protocol (FTP) continues to be a popular method for sending large files between data centres, corporate divisions, branch offices or business partners. But watch out.

A study commissioned by Sterling Commerce, a subsidiary of AT&T that focuses on business and collaboration software, found that nearly a third of companies do the majority, as much as 80 percent, of their large file transfers using FTP. Yet, the same study found that 93 percent of companies experienced failures in FTP transmission. Another survey of manufacturers conducted by Sterling found that about 8 percent of their file transfers fail.

"Companies can no longer rely on the solutions to manage batch file transmission that they had put in place for mainframes," says William McKinney, head of product marketing for the company's managed file transfer (MFT) group. While FTP is free, it's not appropriate for companies transferring medical data or retail sales data to their data centres, he says. "The problem is that it was designed for interoperability, it wasn't designed for security or automation. If something goes wrong, there's no record of it. People just try it again."

Related Articles on Techworld

Large files moving back and forth between corporate groups and their data centres account for the greatest volume of transfers: Financial firms transfer checking account transactions or credit-card data; healthcare companies have to collate and synchronise data on specific procedures with the medical files; and retailers have to upload their latest sales data from their numerous stores.

Dumping FTP Has Compliance Benefits

Moving away from ad hoc FTP data exchange can save companies money and headaches, not only during day to day operations but when being audited for compliance. For companies that want to, or for compliance reasons have to, have assurance that large data files are transferred securely and reliably, adopting a managed file transfer solution makes sense, says Maureen Fleming, program director for IDC's business process automation and deployment group.

"If you have a system that is not all that reliable, and it has an unacceptably high exception rate, and anything less than 99 percent is unacceptable, people will be wondering what happened to that file," Fleming says. "If you cannot figure out what your exception rate is, then you are in trouble because it becomes a brand issue."

The demand has helped the managed file transfer market grow to more than $500 million in 2009, according to Fleming. Vendors playing in this space include Axway (which bought Tumbleweed,) Ipswitch, IBM, Accellion and CA.

"There are a huge number of batch-oriented processes that are going on," Fleming says. "CIOs have to ask, how often do we update and how often do we synchronise the data we have in the cloud with what we have in our data centre."

Finding transfer failures becomes very important to operating smoothly, says Sterling Commerce's McKinney.

"Most people don't realise the value of 'managed' in managed file transfer," he says. "If you have a batch process that kicks off every night to the data centre, when would you like to know that you had a problem with a transfer from one of your stores? At 12 o'clock when you start trying to use that data? No. If this transfer hasn't started by 11:05, you want to get someone in there to fix it."

Managed file transfer solutions offer not only assurances that transfers complete, but more security for the data in transit and better auditing capabilities to satisfy regulations, such as the Health Information Protection and Privacy Act (HIPAA) and Graham-Leach-Bliley (GLB).

Collaboration and Partner Pluses

In addition, companies looking at increased collaboration with partners will want assurances that only authorised people can view certain data and services, says Sam Morris, product marketing manager for Attachmate.

"In the majority of conversations we are having with customers, they are looking for ways to enable the immediate exchange of information between themselves and their partners and customers," Morris says.

Companies that find themselves increasingly dealing with global partners, moving away from physical media and worried about security breaches could benefit from looking at managed file transfer solutions, Morris says.

"Just the ability to know that a file transfer has completed and completed with integrity is something that most companies want," he says.


More from Techworld

More relevant IT news


Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *