For Immediate Release
August 16, 2010

KDHE Office of Communications, 785-296-0461

KDHE Computer Services on Road to Recovery

On August 5, the Kansas Department of Health and Environment (KDHE) began experiencing technical problems which caused 85 percent of KDHE servers to be affected.  This caused disruption in many services Kansans utilize.   

 “While we experienced a failure of our IT infrastructure at a time when service requirements are especially high, it’s important to note that no data has been compromised or lost,” said Roderick Bremby, KDHE Secretary. “This outage has caused many problems for Kansans and we are very sorry for the inconvenience this has caused.  Now, I can say with certainty, that KDHE is on the road to recovery.”

The technical problems stemmed from a failure of the storage area network (SAN). The SAN is a central component of KDHE’s network. KDHE’s network configuration is state-of-the-art and used by many leading organizations. 

Upon observing problems occurring on August 5, KDHE IT staff immediately brought in a team of vendor personnel and leading third-party consultants to assist in diagnosing the problem, rebuilding services and restoring applications.  On August 11, it was discovered by IT staff and a third-party consultant brought on board, that the hardware was a factor. 

A new SAN was shipped from the vendor August 12 and arrived August 13, along with vendor personnel who began working with KDHE staff on installation.  Currently KDHE staff, along with the vendors, are working diligently to restore all services.  However, with 150 servers and 25 terabytes of data, restoration is a time consuming and ongoing process.

“As a parent, I understand the need for documents to enroll your child in school and the frustration with not being able to attain them,” said Secretary Bremby. “This has been hard for everyone and we appreciate your patience.”

Priority has been given to the systems with the most public impact – though other smaller systems may also become functional in the interim. KDHE IT staff is continuing to work around the clock to complete this monumental effort.  Systems currently online include Women, Infants and Children Program (WIC), Immunization Registry, Child Care Licensing, Kansas Information for Communities, Lab Certification and a few others.

“If not for our IT staff – their knowledge, expertise and dedication – the situation we are currently facing would be much worse,” said Secretary Bremby.  “We want Kansans to know their needs have always been and continue to be our number one priority through this event.”

KDHE Server System Presenatation