Legal Services Offshore research · legal-support-quality

Measuring docket change review coverage across active matters

A bounded method for checking whether every active matter received a dated docket review, without treating coverage as proof that no deadline was missed.

Published · 4 sources

Measuring docket change review coverage across active matters research illustration

Research context

This research brief is designed for legal operations planning. Use the findings to ask better workflow questions. Test any proposed process against the firm’s jurisdiction, professional duties, systems, and client commitments. Treat every local result as a starting point for review rather than a universal benchmark.

Question and scope

This study asks what share of active matters received a dated docket review during a defined period, and where coverage gaps cluster. It treats a completed review as a recorded check against named sources, not as proof that the docket contained no relevant change. The scope is one firm or department, a fixed matter list, and a stated review window. The result is a local operational measure and should not be described as an industry rate.

The unit is one active matter for one review period. A matter reviewed twice in the period still counts once for coverage, but both dates are recorded. A matter with no review is reported as uncovered rather than assumed to have no changes. The study records the court, the case number, the assigned reviewer, and the source used. Those fields let a reader see whether the population and the review method are comparable.

Method and evidence standard

Freeze the active matter list at the start of the period and record any matter added or closed during it. For each matter, capture the last review date, the reviewer, the docket source, and the meeting or log where the review was reported. A calendar entry alone is not a review. The evidence should show that a person checked the source and recorded a result. Two reviewers should agree on what counts as complete before the sample is scored.

Define the review window and the acceptable sources in advance. If a court's public docket and a paid service are both approved, record which one was used and whether the other was checked. A matter under seal may require a different evidence standard, so record the exception. Do not count a general status update as a docket review unless it names the source and the date. The method should be strict enough that a second person can reproduce the coverage count.

Measures and data quality

Report the number of matters in the population, the number with at least one documented review, and the number with none. Show the median days since the last review and the oldest review in the uncovered group. Break coverage down by practice group, court, and reviewer only when the groups are large enough to describe. Include matters that were added mid-period and matters that closed. A coverage rate without the population size is hard to interpret.

Check for duplicate matters, missing case numbers, reviews recorded under the wrong matter, and dates that fall outside the period. Record each correction and the source used to resolve it. If a reviewer checked a docket but did not write it down, the matter should remain uncovered for the study. That may feel harsh, but it keeps the measure about evidence rather than memory. The data quality note should list every judgment call.

Findings and interpretation

Look for patterns before assigning a cause. A gap concentrated in one court may reflect a source the team cannot access, while a gap across courts may reflect an unclear review schedule. A gap among newly added matters may reflect an onboarding step that never happened. Read the underlying logs and messages for the largest clusters. Do not conclude that an uncovered matter had no docket activity. The finding is about the review record.

Compare coverage with the review process, not with individual effort. If most uncovered matters were assigned to one reviewer who also covered a large caseload, the issue may be capacity. If uncovered matters cluster around one practice group, the issue may be an unclear owner. Report the pattern with the evidence and the uncertainty. The study can point to a process question; it cannot decide whether a deadline was missed.

Limitations

The study sees the review log and cannot observe every informal check a lawyer or assistant performed. A matter may be well monitored even when the log is incomplete, and a logged review may be superficial. The study also cannot determine whether the docket source was current or whether the reviewer understood the entry. Court systems change, and a source that worked last month may fail this month. The result is a snapshot of the record.

The window may be too short to capture a monthly review cycle, and a matter closed during the period may have received a final check outside the log. Sealed matters and unavailable sources may be excluded or flagged, which changes the denominator. If the firm changed its review process during the period, the coverage rate may combine two different standards. Record these limits and keep the exception list with the result.

Practical next step

Choose one change that addresses the largest documented gap, such as a weekly review list with a named owner, a source check for courts that require a separate login, or an onboarding step for new matters. Write the change and the date it starts, then define the same coverage measure for the next period. Keep the old and new results separate. A repeated measure shows whether the change affected the record.

Review the result with the lawyers who own the matters and the person who keeps the review log. Ask which exceptions are acceptable and which require a different process. If a court source is unreliable, record the fallback and the person who checks it. Do not add a new dashboard unless the team will use it. The next step should reduce a specific gap, not add another layer of reporting.

What the evidence does not show

Coverage does not prove that a docket was read correctly, that a deadline was calculated properly, or that a filing was made on time. It also does not establish that the firm's review schedule meets a professional or client requirement. A high coverage rate can coexist with a serious error, and a low rate can coexist with careful informal monitoring. The measure must be paired with a quality review of actual entries.

Do not publish a matter-level result that could expose a client or identify a reviewer. Keep the sample size, the source list, and the exception decisions with the study. If the firm needs to know whether a deadline was met, it should examine the specific filing and the applicable rule. The coverage study is an administrative check that helps the firm ask where its review process is weak.

Separating coverage from quality

A coverage count can be high while the quality of each review is low. Add a small quality check that reads a sample of entries and asks whether the reviewer recorded the source, the comparison, and the result. Score the sample separately from coverage so a complete log is not mistaken for a good review. If the quality sample is weak, the next step may be training or a clearer template rather than more reminders. The two measures answer different questions.

Keep the quality review small enough to repeat. A sample of ten matters across courts and reviewers is more useful than an annual audit of everything. Record the sample method and the errors found, and check whether the same error appears in more than one reviewer. Do not publish a reviewer-level score. The purpose is to improve the record, not to rank people.

Building the next review sample

For the next period, keep the same population definition and the same evidence standard so the comparison is meaningful. If the firm adds a court source or changes the review schedule, record the date and analyze the periods separately. Include matters that were uncovered in the first period and see whether they are now covered. A simple before-and-after table is enough. The goal is to show whether the change reached the matters that needed it.

If the next sample shows no improvement, check whether the change was actually used. A new checklist that sits in a folder does not change the review. Ask the reviewers what got in the way and record the answer. Then decide whether to revise the control or the measure. A negative result is still useful when it is documented honestly.

Sources and method

Open each source to confirm its scope, publication date, and applicability before relying on it for a legal workflow decision.

  1. U.S. Courts, electronic filing and CM/ECF
  2. PACER, public access to court electronic records
  3. American Bar Association, Litigation Section
  4. GAO, Standards for Internal Control in the Federal Government

Related research

Bring the messy task list

We will help turn it into one clear legal support role.

Share the work, tools, hours, and review needs. The next step is a practical staffing scope, not a public rate card.