Borrowed in Brooklyn

Methodology

Borrowed in Brooklyn follows a changing selection of adult physical books at Brooklyn Public Library. Most Popular uses the same borrowing foundation overall and at each branch: copies on loan now, recent checkouts, and sustained borrowing growth. System-wide holds provide a smaller supplement to the overall score; On the Rise highlights emerging interest outside that list. Branch rankings use local borrowing evidence only. A book does not become popular in our rankings simply because its one or two copies are unavailable.

We use public catalog counts, with local availability at eleven selected branches. This is a view of the books we track, not every book or every reader in Brooklyn. No individual patron records are used.

What we observe

Existing scheduled scans read BPL’s public discovery catalog. The same responses contain physical-copy checkout and renewal counters, system-wide public holds, and item locations and statuses. We retain those counts without adding catalog requests or scraping runs.

Borrowing means observed increases in checkout counters, not unique readers or proof a book was finished. Holds are outstanding requests, not a count of new requests placed during the period. Availability is practical context: items can be unavailable because they are borrowed, awaiting pickup, in transit, being processed, or otherwise off the shelf.

Scope and editions

We exclude records explicitly marked for children or teens, digital editions, and other media. Adult books about younger people remain eligible. The catalog’s work grouping helps prevent duplicate chart entries: we show the highest-ranked eligible record for a group. We do not sum possibly shared hold queues or overlapping item sets across editions. Counts refer to the displayed bibliographic record and can omit activity on other editions. Missing grouping falls back to the record ID.

A regularly refreshed selection

We regularly refresh the tracked selection using new catalog discoveries, retaining active books and introducing new candidates within a fixed collection budget. Tracking stays capped at 360 titles.

Existing popularity searches, rotating deeper pages, recent catalog additions, and category and language searches find candidates. Weekly NYT bestseller seeds and a small watchlist supplement discovery. These sources help find books; they add no popularity points.

We admit up to 3 titles per UTC day and 20 per rolling seven days, including returning titles. When the pool is full, incoming books replace quieter titles. New admissions have a 28-day observation period before competing for retention. We do not force replacements when there are no eligible candidates or all places are protected.

Intake and retention details

Discovery sources rotate in daily priority, with duplicate books removed across branches and searches. Never-tracked titles receive priority within each source; older waiting candidates precede newer candidates. Previously tracked books can return after fourteen days without observation. Each admission or reactivation consumes the same intake budget and starts its protected period; continuous tracking never restarts that clock.

Established titles are retained first by recent observed borrowing once at least seven days are covered, then by fresh public hold counts. Scarcity earns no retention points. Missing activity evidence is protected rather than treated as quiet. Active eligible titles do not lose tracking merely because a search stops rediscovering them. Audience exclusions and low-signal retirement still apply. Low-signal retirement requires fresh observations, fewer than ten outstanding holds, and fewer than ten observed checkouts with at least 24 covered days; missing measures cannot establish low activity. A candidate can wait for a slot; discovery is bounded, not an exhaustive catalog census.

The search budget is unchanged: fourteen category/language queries request the first popularity page and a deeper page rotating through pages 2–8. Recent-addition searches request three broad pages and one for each other category. This is 880 requested result slots per full run before duplicates or short pages. Retrieval categories are search terms, not verified genres; recently added means added to the catalog, not necessarily newly published.

Most Popular

Most Popular combines copies currently on loan, recent observed checkouts, and a smaller boost for sustained borrowing growth. Both the overall and branch lists use this borrowing foundation, measured at their respective scopes. The overall list also gets smaller contributions from outstanding system-wide holds and sustained hold growth. Absolute counts contribute logarithmically; unavailable percentages earn no points. The ten highest-scoring books form Most Popular.

The combined ranking formula
borrowing foundation = ln(1 + copies on loan now) + ln(1 + observed loans)
                    + 0.25 × ln(1 + qualifying loan gain)
overall supplement = 0.25 × ln(1 + current system-wide holds)
                   + 0.25 × ln(1 + qualifying net hold gain)
overall Most Popular = borrowing foundation + overall supplement
branch Most Popular = borrowing foundation at that branch

Current on-loan counts are catalog-inferred normally circulating copies with due dates. They measure a point-in-time stock, influenced by collection size and loan duration. Observed new loans measure activity: they cover the last 28 days and need at least 24 days of valid intervals. Current holds are absolute system-wide outstanding requests. Growth terms contribute only after meeting the sustained-growth rules below. The weights are initial editorial choices, not a fitted prediction of future bestsellers. The score is a ranking index, not a total of loans and requests.

Missing or insufficiently covered signals add no evidence; their counts stay unknown rather than becoming measured zeros. We do not redistribute their weight to other signals. Rankings are provisional while counter history accumulates, so better-observed books can have an evidence advantage. Older saved responses did not retain full-system current-loan totals. Those totals begin arriving through the existing scheduled rotation, usually about two days for the pool. We never substitute the sum of eleven tracked branches for a system-wide count. Until a book has borrowing evidence, holds and qualified hold growth can still establish its Brooklyn-wide score at their smaller weights. They never replace missing local borrowing in a branch ranking. Equal scores use record ID as a stable tie-breaker.

Shelf availability, holds per copy, unused collection capacity, and inventory changes add no popularity points. Loaned copies contribute as an absolute current audience; merely owning more copies does not. Two loaned copies contribute less current-loan evidence than six; two unavailable copies in transit contribute none. New copies establish counter baselines; they do not create loans. Supply growth alone does not prove acquisitions or reader demand.

Checkout measurement and missing history

We match the same physical item ID across complete observations and take the nonnegative increase in its lifetime checkout counter. First-seen items establish baselines; their previous lifetime borrowing does not become recent activity. We keep renewal increases separate and do not add them to borrowing rankings.

Counter comparisons must be at least one minute and at most three days apart. At least 90% of current copies must expose checkout counters, and valid matched counters must cover at least 90% of the preceding copy set. Intervals that fail those coverage checks, or span long gaps, are unknown rather than zero. A transfer does not establish branch-level activity; affected local comparisons fail the same coverage check.

Only complete, nonoverlapping intervals contained within a reporting window contribute. We do not invent daily loan dates or interpolate across window boundaries. The count is observed activity within the window, not an exact total of all loans made in 28 calendar days. Observation gaps and newly added copies can reduce coverage.

Historical availability changes and lifetime totals cannot backfill borrowing windows. Missing borrowing evidence means more counter history is needed, not that no books were borrowed. Public pages read precomputed summaries; counter histories are processed after existing scrape batches and score refreshes.

On the Rise

The Brooklyn-wide On the Rise list shows up to six books outside Most Popular with substantial, sustained growth in borrowing or public holds. Both growth signals contribute to one ordering: 0.25 × ln(1 + qualifying loan gain) + 0.25 × ln(1 + qualifying net hold gain). Ties use the combined popularity score, then record ID. These are two categories, not separate borrowing and request rankings.

Borrowing accelerating: compare the latest fortnight with the preceding fortnight. Each needs at least eleven days of valid intervals. The latest needs at least ten observed checkouts, at least five more than before, at least two positive intervals, and a checkout rate at least 25% higher after accounting for covered days. A fully observed zero baseline can qualify; missing history cannot. The qualifying absolute checkout gain contributes to the combined ranking.

Requests building: within the latest fourteen days, require at least three actual observation days spanning four days, at least ten current holds, at least five net additional holds, and at least 25% growth when the initial queue is positive. At least two observed increases establish persistence. The qualifying net hold gain contributes to the combined ranking.

Adding or removing copies does not change a book’s request-growth calculation. One to three holds does not qualify. Copies and availability remain context. A book can qualify through either or both growth signals. We deduplicate work groups before selecting the categories, so the same work does not appear in both. The category can be short or empty.

Queue growth is net: fulfillment and cancellations can reduce holds even when interest is strong. A growing queue is evidence of growing outstanding requests, not a forecast that a book will become a national bestseller. Some snapshots may have no qualifying On the Rise entries.

What branch pages mean

The eleven tracked branches form a geographic sample, not a representative survey. Borough borrowing counts use observable copies system-wide for the tracked record. Branch borrowing counts use matched copies associated with that branch’s collection.

A collection location does not establish the checkout or pickup branch, or where a reader lives. Branch Most Popular combines catalog-inferred copies currently on loan with adequately observed recent checkouts and qualified local checkout growth. A book can qualify immediately through a positive current on-loan count; the recent-checkout term needs at least 24 covered days within 28 days. These are absolute counts, never the percentage of a small collection that is unavailable. Branch On the Rise uses qualified local borrowing growth outside that branch’s Most Popular list; it can qualify with eleven covered days in each consecutive fortnight. System-wide holds and hold growth add no branch ranking points and do not qualify books for local On the Rise. They remain clearly labelled context. Missing checkout history does not prevent ranking current on-loan copies. If neither current loans nor adequately observed recent checkouts are available, we show a local-evidence message and never substitute the Brooklyn-wide ranking. These are not local hold queues or neighborhood preference rankings.

How current on-loan copies are measured

The existing catalog response includes item-status counts and shelf-ready counts for every returned branch, including those outside our eleven-branch panel. We validate and sum these counts across the complete response for the overall total, retaining one compact count in activity observations. Branch counts are recovered from existing saved snapshots. The parser includes normal-status copies in CHECK SHELVES whether or not they have a due date, but only normal-status copies without a due date count as shelf-ready. Subtracting shelf-ready copies from that normal-status count recovers normally circulating copies with a recorded due date. Both scopes use the same normal-status minus shelf-ready calculation. This is a catalog-inferred current loan count, not a count of new checkouts during a reporting period.

We validate that all known status counts add up to total inventory and that normal-status counts cover shelf-ready counts. Missing, unrecognized, or inconsistent status data stays unknown. Holdshelf, transit, processing, missing, lost, billed, and long-overdue statuses do not become normal current loans. Snapshots must be within 72 hours, from the active eligible pool, and use the corrected Central mapping. No extra catalog request or new scraping run is needed.

Branch ranking formulas
branch Most Popular = ln(1 + catalog-inferred copies on loan now)
                    + ln(1 + observed local checkouts over 28 days)
                    + 0.25 × ln(1 + qualifying local loan gain)
branch On the Rise = 0.25 × ln(1 + qualifying local loan gain)
system-wide holds and hold growth = context only; no branch points

Most Popular needs positive current on-loan copies or positive observed recent checkouts. Only the recent-checkout term needs 24 covered days; current on-loan counts come from a fresh snapshot. On the Rise uses the borrowing-growth requirements above and excludes works already in that branch’s Most Popular. Its ties use the local popularity score, then record ID. Books must have fresh holdings at the branch. A book’s shelf-availability percentage adds no points.

Availability and branch comparisons

Regional availability summaries and book availability describe access to copies separately from the popularity ranking. Their existing 0–100 availability-pressure index combines scarcity with recent availability declines. A high pressure score does not mean high borrowing volume.

The single comparison heatmap measures the mix of copies currently on loan from each branch’s collection. It uses the same catalog-inferred current-loan counts as branch Most Popular. For each pair, we use titles carried at both branches with known counts from snapshots within 72 hours. Each title’s share is its loaned copies divided by all loaned copies in that pair’s comparable set. Overlap is the sum of the smaller branch share for each title: 100% means identical current-loan mixes within that set.

A pair needs ten comparable titles with copies on loan at either branch, thirty loaned copies at each branch, and at least 50% of each branch’s known current loans in the tracked selection represented by the common set. Missing counts and absent holdings are excluded, never treated as zero; an observed zero is valid. Coverage excludes books with unknown loan counts and does not describe the whole collection. Cells with insufficient evidence remain blank. A first qualifying snapshot can contribute immediately; there is no 28-day waiting period.

We select one record per work across the comparison, prioritizing the record with the most known current loans across tracked carrying branches, then the lower record ID. We never sum overlapping editions. Counts describe a current stock, influenced by loan duration and collection supply, rather than new checkouts over a month. Snapshots may have different observation times within the freshness window. Holds, shelf percentages, and checkout history do not affect this heatmap. Different pairs can use different title sets, so the scores describe pair comparisons rather than a league table of branch tastes.

For a qualifying selected pair, Shared favorites shows up to three books loaned at both branches, ordered by the smaller loan share (their contribution to overlap), then combined loaned copies and record ID. More prominent at each branch shows up to two other books with at least three loaned copies there and a loan share at least one percentage point above the other branch, ordered by the share difference, favored branch count, then record ID. Work groups appear once across all three groups, with shared favorites selected first. Known zero counts at the other branch can qualify; missing or absent holdings cannot. Short or empty groups are shown honestly. These selections explain the comparison without changing its score, and do not establish reader preferences.

Availability-pressure formulas
footprint = min(1, 0.5 + 0.5 × ln(1 + total copies) / ln(13))
scarcity = round(80 × (1 − available / total) × footprint)
movement = round(20 × declining comparisons / comparable observations)
branch availability pressure = scarcity + movement
panel availability pressure = mean(pressure at carrying branches)
local difference = pressure here − mean(pressure at OTHER carriers)

Availability scoring uses the last snapshot per UTC day, comparing consecutive observations at most three days apart with positive, unchanged inventory. Comparisons ending in the latest week contribute; no comparisons earn no movement points. A single declining comparison can earn all twenty movement points. These are access heuristics, not circulation estimates.

Standouts require three carrying branches. Missing holdings are excluded from the local average. Regional pressure averages carrying branches, and available-copy counts describe current shelves, not uninterrupted availability.

Data quality

Current activity observations must be within 72 hours, and titles must be active and adult-eligible. Missing holds remain missing. Only actual observations enter trends; carrying forward a displayed hold count does not create history. Access-context counts carried forward expire after 72 hours.

Availability data-quality labels describe coverage and observation history, not statistical certainty. High branch coverage requires three copies and three observation days spanning 48 hours. High panel coverage needs at least five carrying branches and ten copies, with adequate history at every carrier. These labels do not establish a prediction’s accuracy.

A complete item response can establish zero inventory at a previously observed branch. Failed or incomplete responses cannot. Central’s department locations are combined; observations from before the corrected mapping are excluded from availability comparisons. Public catalog updates can lag transactions.

Refresh schedule and performance

Discovery runs daily. The existing two daily scrape batches each attempt up to 100 due titles; a 360-title rotation usually takes about two days. Checkout counters come from those same responses. There are no additional scheduled scraping runs or additional per-title requests for activity scoring.

We keep one current counter state per record and compact title/branch observations, rather than a growing archive of every copy’s full record. Rankings refresh after batches and on existing score jobs. Public reads cache for up to ten minutes and completed jobs invalidate the cache.

Operations and retention

Schedules are UTC: discovery 10:30; scraping 11:00 and 23:00; score reconciliation 11:32 and 23:32. NYT/watchlist refresh is Monday 12:00; cleanup is Monday 09:00. Successful titles have a 24-hour cooldown; failures back off twelve hours. New admissions and the oldest observations get priority within the same batch budget.

Jobs share a database lease. A scrape batch stops intake after 420 seconds; unfinished titles stay queued. Runs distinguish success, partial completion, and errors. The footer shows the newest individual scan, not completion of the whole pool. Compact activity and availability history are retained for ninety days, with weekly cleanup; movement events have a 180-day retention window.

Checkout-history model: reading-activity-v1. Availability model: demand-pressure-v4.0. Public summaries are recalculated from stored observations, without refetching the catalog.

Sources and limitations

BPL’s public catalog supplies the counts and metadata. The NYT Books API supports discovery and bestseller-history context; it contributes no local demand points. Cover images are presentation only.

Selection, edition grouping, missing observations, supply constraints, and catalog corrections affect results. Physical borrowing captures only part of Brooklyn reading. The project is independent of BPL and The New York Times.