• Introduction and Context
• All Active Projects Must Participate
• Process Overview
  • Chicago DQ Report (Missing Values, Child-only Entries, and Bed Utilization)
  • Timeliness Report (Timeliness)
• Timeline
• Compliance Thresholds
  • Missing Values
  • Child-only Entries
  • Bed or Room/Unit Utilization
  • Timeliness
• Submission Process
  • Prepping Reports
  • Sending the Report
• User Support

This is one of three articles about the data quality process. This article describes the overall structure of the data quality process and outlines the compliance measurements that your project will be measured on.

For instructions on how to run and interpret the report, please go here. 

 

Introduction and Context

The Chicago Continuum of Care (CoC) utilizes data-informed approaches to coordinate services and resources in its efforts to end homelessness.  Homeless Management Information System (HMIS) data quality is an important factor to measure efforts to end or prevent homelessness. The CoC relies on the work of all providers of all funding types to enter accurate, complete, and timely data to ensure we have the information we need to make informed decisions as a community.

The HMIS Data Quality Assessment process addresses completeness, accuracy, and timeliness of the data entered by service providers into HMIS, as guided by the Chicago HMIS Data Quality Plan.

In order to maintain data quality, providers will have access to a report accessible through the HMIS system. The report will address data in the following areas:

• Missing Values – Clients missing required assessment data undermines effective analysis of client data.
• Child-Only Entries – These entries are largely children erroneously enrolled in projects without their appropriate guardian grouped with them. These data entry errors hinder providers’ ability to count the number of families and individuals enrolled in a project.
• Bed Utilization – If HMIS shows the number of clients/families enrolled in a housing project is vastly different from the number of beds/rooms the project has, this might indicate there is a discrepancy between which clients are enrolled in the project in real life and which are indicated as being enrolled by HMIS data.
• Timeliness – Data should be entered into HMIS immediately after the event (i.e. individual’s entry into a project). Timely data entry ensures the data are accessible when they are needed and for the use in the Coordinated Entry System (CES).

This article goes over the structure and overall process of Data Quality, click the following links for specifics on how to run and interpret the report and how to clean your data.

 

Webinar

This webinar was recorded on October 7th. The slides can be found here.  A more recent webinar will be posted the day after it is recorded.

 

 

All Active Projects Must Participate

All projects, regardless of funding, are required to participate in the quarterly data quality process. So long as a project is active and has at least one client enrolled, it is expected that the data quality report for said project be submitted.

Please refer to this sheet for a list of currently active projects that are expected to participate in the data quality process. Please be aware that you must inform the HMIS Team if a project is no longer operational, active, or using ServicePoint; you may do so either by emailing HelpDesk@allchicago.org or by submitting a ticket.

 

Process Overview

The Data Quality process includes two different reports. The Chicago DQ report covers Missing Values, Child-only Entries, and Bed Utilization; the Timeliness report covers Timeliness.

Chicago DQ Report (Missing Values, Child-only Entries, and Bed Utilization)

The Chicago DQ Report is a self-service report accessible within the Advanced Reporting Tool (ART) by Agency Technical Administrators.

This report will flag any elements that are missing or that were entered incorrectly, providing a place for users to begin the process of troubleshooting and correcting data. Please keep in mind that data within HMIS will be reflected in the ART report the following day (e.g., corrections made to a client’s record on 3/10/2020 will not be visible in the report until 3/11/2020).

If your project has legitimate child-only entries, or your unit list has not yet been updated, please refer to these links:

• Child Only Entry
• Utilization Non-Compliance
  • If your project had any construction issues or a reason for why the units/beds were not available

Regardless of the state of the data, every provider must submit a report to All Chicago by the first deadline (Oct 20th). If the data does not meet compliance, the provider will need to correct the issues within HMIS the day before the second and final report deadline (Oct 29th) before re-submitting.

For a full guide on interpreting the report and how to troubleshoot data errors, please refer to this article.

 

Timeliness Report

Timeliness is tracked through an automated report created by All Chicago. The report will be provided during each quarterly DQ process, and can be scheduled more frequently at the provider’s request.

This timeliness report will track timeliness:

• At entry
• At exit
• At housing move-in dates
• For shelter services

Timeliness measures the time it takes to create an element in HMIS. This measure applies even if the entry date is backdated. For instance, if a client originally came into a project on 2/1/2020, but they were not entered into that project in HMIS until 2/15/2020, the information will be considered out of compliance as it took 14 days to indicate that the client was enrolled in the project. Timeliness data cannot be corrected.  

 

Data Quality Process Timeline

The reports run for this Data Quality Assessment process will look at clients enrolled between 10/1/2019 and 09/30/2020.

Below are dates to observe:

Wednesday Sept 30 Notice	All Chicago sends out notification to agencies to submit the Chicago DQ report.
Monday, Oct 5 Notice	DQ report is made available to run in ART and agencies may begin submitting. Timeliness reports will be sent out to ATAs during the week.
Tuesday, Oct 20 1st Round Due	Submission of Chicago DQ reports due no later than 5:00pm. There must be a report per project (though these reports can be in the same email). Send your report submission email to DataQuality@allchicago.org. (Remember: anything you add or delete within HMIS Monday won’t show up in ART until Tuesday. If you need to add or delete anything that will be on the report, complete that by Monday, Oct 19).
Friday, Oct 23 1st Round Results	All Chicago will post all projects’ results at http://bit.ly/ChicagoDataQuality. Projects that have: ●     Any data elements with missing values amounting to more than 5% of clients enrolled, ●     One or more child-only entries or ...will need to correct their data. Projects whose missing data elements fall under 5%, have zero erroneous child-only entries, or are not out of the range of compliance for utilization do not need take any further action, and do not have to correct data for the second round.
Thursday, Oct 29 2nd Round of Corrections Due	For those projects who needed to fix data, the re-submission of the reports with updated and corrected data is due by 5:00pm. Again, all updates will need to be made the day prior, Oct 28, so it shows up on the report the next day.
Tuesday November 3 Final Results	All Chicago will post the numbers based on projects’ final report submissions at http://bit.ly/ChicagoDataQuality.

 

Compliance Thresholds

In order to be fully compliant with the Data Quality Assessment process, all HMIS providers must submit and/or correct the HMIS generated reports by the deadlines listed and with the methods specified in this document.

 

Missing Values

No more than 5% of clients enrolled in the project can miss any data element. This is calculated by looking at the average of the “% Missing” column on the summary page of the Chicago DQ Report.

 

Child-only Entries

There must be zero child-only entries. A child only entry is flagged when a client under the age of 18 is enrolled in a project without being connected to a parent/guardian. This can happen for two reasons:

1. The child was entered separately from their parent/guardian
2. The client’s date of birth is missing

In instances where a provider is working with an unaccompanied minor, please complete the child only exemption form.

 

Bed or Room/Unit Utilization

Bed or room/unit utilization must be within the following ranges:

• Emergency Shelters: 80%-105%
• Transitional Housing: 80% - 105%
• Permanent Supportive Housing: 85% - 105%
• Safe Haven: 85% - 105%

The utilization looks at how many clients were enrolled in your project on July 30, 2020 as compared to how many beds/units are indicated in your Bed and Unit Inventory sheet.  

If a project is over/under-utilizing their bed list, but is in compliance for their unit utilization, then the project will still be in compliance. The opposite situation would also count as being in compliance. So long as either bed or unit utilization is in compliance, the project as a whole will be considered compliant.

If you believe the bed/unit numbers are erroneous, please submit a Helpdesk ticket indicating why. We will be measuring based on how many beds/units your project reported having on July 30, 2020.

If there was a reason why beds/units were not in use, such as construction or an emergency, please submit a utilization non-compliance form.

 

Timeliness

Timeliness rates for entries, housing move-in dates, exits, and shelter services must be above 90%.

The following timeframes are required for any of these elements to be considered compliant for timeliness.

• New project enrollments (“Entries”)
  • When a client is initially enrolled in a project, the following information must be entered into HMIS within two days:
    • Name
    • Gender
    • Date of birth
    • Household composition
    • Project Entry Date
    • Project
  • Exits from project enrollments (“Exits”)
    • For all bed-based project types (Emergency Shelter, Safe Haven, Transitional Housing, and various Permanent Housing projects), projects should exit clients from their project in HMIS no more than two (2) days after their last stay.
    • For all other project types (Services Only, Rapid Re-Housing, Street Outreach, Day Shelter, Homelessness Prevention, Other), projects should exit clients from their project in HMIS no more than seven (7) days after their last contact.
  • Service records for stays at shelters (“Shelter Stay Services”) must be entered into HMIS within two days
  • Housing Move-in Dates should be documented within two business days of the client moving into their unit

 

Submission Process

The report is to be submitted before the first round deadline (Oct 20^th), and the second round deadline (Oct 29^th). For a full overview of the timeline, please review our process article.

Any projects listed in on this spreadsheet are expected to participate.

 

Prepping Reports

After downloading the Excel version of the Chicago DQ report from ART, the files must be renamed using the ChicagoDQ_----_yyyy-mm-dd template.

If you were to run a report for the sample project “All Chicago – Emergency Shelter(883)”, the file would be renamed to: ChicagoDQ_0883_2020-03-04.

The date can be updated to whenever you submit the report – it is simply for tracking purposes. However, inputting your project’s HMIS ID in the place of the dashes is critical.

 

Sending the Reports

To submit the Chicago DQ report, please create an email to dataquality@allchicago.org. 

• To: dataquality@allchicago.org
• Subject: Data Quality Report Submission Attachments

You may attach all of your data quality reports together in one email, no need to send them separately.

Example below: 

 

 

User Support

The HMIS Team will conduct two webinars to help you with your DQ reports.  Assistance can also be requested through the Help Desk.

Please register here for the webinars:

• Wed, Oct 7 @ 10 am
• Tues, Oct 27 @ 11 am

Additionally, agencies will be able to request dates to meet with the HMIS Team to address any questions or issues they have with their reports. Before requesting a session, please note the following:

• All sessions are limited to 30 minutes
• These sessions will be done online - please ensure your computer has the capacity to record audio
• An Agency Technical Administrator, or someone with ART access, must be on the call as well
• Please open a ticket with the Help Desk highlighting any specific clients that need troubleshooting
• Please have your report scheduled so that the HMIS team member can pull your information quickly, or email the report you plan on referencing beforehand
  • Doing so will save you time during the session

Quick DQ Troubleshooting Run Through