bobbin-ai 0.25.2

Local-first context injection engine for AI coding agents
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216

# Ruff (Rust)

## ruff-001 <span class="eval-medium">medium</span>

**Commit**: [f14fd5d885](https://github.com/astral-sh/ruff/commit/f14fd5d88507553830d78cf3cfae625a17297ebd)

<details>
<summary>Task prompt</summary>

> Fix the Python formatter to preserve parentheses around exception handler
tuples when any element is a starred expression (Python 3.14+). Without
parentheses, a starred element in an except clause is parsed as `except*`
(exception group syntax) rather than a tuple containing a starred element,
changing semantics. Add a check for starred expressions in the tuple before
removing parentheses.

</details>

| Approach | Tests Pass | Precision | Recall | F1 | Duration | Cost |
| -------- | :--------: | :-------: | :----: | :-: | :------: | ---: |
| no-bobbin | 100.0% | 31.7% | 33.3% | 32.4% | 4.3m | $1.23 |
| with-bobbin | 100.0% | 70.2% | 61.9% | 63.6% | 4.4m | $1.52 |
| with-bobbin+blame_bridging=false | 100.0% | 33.3% | 33.3% | 33.3% | 4.6m | $1.25 |
| with-bobbin+coupling_depth=0 | 100.0% | 55.6% | 33.3% | 38.9% | 4.7m | $1.45 |
| with-bobbin+doc_demotion=0.0 | 100.0% | 55.6% | 55.6% | 55.6% | 5.0m | $1.48 |
| with-bobbin+gate_threshold=1.0 | 100.0% | 77.8% | 55.6% | 61.1% | 5.4m | $1.39 |
| with-bobbin+recency_weight=0.0 | 100.0% | 77.8% | 55.6% | 61.1% | 4.9m | $1.43 |
| with-bobbin+semantic_weight=0.0 | 100.0% | 23.6% | 33.3% | 25.2% | 4.7m | $1.45 |

<div class="eval-chart">

![ruff-001_f1_boxplot.svg](./charts/ruff-001_f1_boxplot.svg)

</div>

<div class="eval-chart">

![ruff-001_duration.svg](./charts/ruff-001_duration.svg)

</div>

**Ground truth files**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/statement/try.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@statement__try.py.snap`

**Files touched (no-bobbin)**: `crates/ruff_python_formatter/resources/test/fixtures/black/cases/remove_except_types_parens.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/black_compatibility@cases__remove_except_types_parens.py.snap`
**Files touched (with-bobbin)**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/statement/try.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@statement__try.py.snap`
**Files touched (with-bobbin+blame_bridging=false)**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/except_handler_starred.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@except_handler_starred.py.snap`
**Files touched (with-bobbin+coupling_depth=0)**: `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`
**Files touched (with-bobbin+doc_demotion=0.0)**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/statement/try.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@statement__try.py.snap`
**Files touched (with-bobbin+gate_threshold=1.0)**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/statement/try.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@statement__try.py.snap`
**Files touched (with-bobbin+recency_weight=0.0)**: `crates/ruff_python_formatter/resources/test/fixtures/ruff/statement/try.py`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`, `crates/ruff_python_formatter/tests/snapshots/format@statement__try.py.snap`
**Files touched (with-bobbin+semantic_weight=0.0)**: `crates/ruff_python_formatter/resources/test/fixtures/black/cases/remove_except_types_parens.py`, `crates/ruff_python_formatter/resources/test/fixtures/black/cases/remove_except_types_parens.py.expect`, `crates/ruff_python_formatter/src/other/except_handler_except_handler.rs`

---

## ruff-002 <span class="eval-easy">easy</span>

**Commit**: [ddeadcbd18](https://github.com/astral-sh/ruff/commit/ddeadcbd18a2b3319a2f5963c16191d14d44bca9)

<details>
<summary>Task prompt</summary>

> Add `multiprocessing.Value` to the list of functions excluded from the
flake8-boolean-trap rule FBT003. The `Value` constructor commonly takes a
boolean as its second argument (e.g., `Value("b", False)`), and this is a
legitimate use case that should not trigger a boolean positional argument
warning. Implement a new `is\_semantically\_allowed\_func\_call` helper that
uses qualified name resolution to match the call, and integrate it into the
existing `allow\_boolean\_trap` logic.

</details>

| Approach | Tests Pass | Precision | Recall | F1 | Duration | Cost |
| -------- | :--------: | :-------: | :----: | :-: | :------: | ---: |
| no-bobbin | 100.0% | 100.0% | 40.0% | 57.1% | 4.8m | $0.00 |
| with-bobbin | 100.0% | 100.0% | 40.0% | 57.1% | 4.3m | $1.38 |

<div class="eval-chart">

![ruff-002_f1_boxplot.svg](./charts/ruff-002_f1_boxplot.svg)

</div>

<div class="eval-chart">

![ruff-002_duration.svg](./charts/ruff-002_duration.svg)

</div>

**Ground truth files**: `crates/ruff_linter/resources/test/fixtures/flake8_boolean_trap/FBT.py`, `crates/ruff_linter/src/rules/flake8_boolean_trap/helpers.rs`, `crates/ruff_linter/src/rules/flake8_boolean_trap/snapshots/ruff_linter__rules__flake8_boolean_trap__tests__FBT001_FBT.py.snap`, `crates/ruff_linter/src/rules/flake8_boolean_trap/snapshots/ruff_linter__rules__flake8_boolean_trap__tests__FBT003_FBT.py.snap`, `crates/ruff_linter/src/rules/flake8_boolean_trap/snapshots/ruff_linter__rules__flake8_boolean_trap__tests__extend_allowed_callable.snap`

**Files touched (no-bobbin)**: `crates/ruff_linter/resources/test/fixtures/flake8_boolean_trap/FBT.py`, `crates/ruff_linter/src/rules/flake8_boolean_trap/helpers.rs`
**Files touched (with-bobbin)**: `crates/ruff_linter/resources/test/fixtures/flake8_boolean_trap/FBT.py`, `crates/ruff_linter/src/rules/flake8_boolean_trap/helpers.rs`

---

## ruff-003 <span class="eval-medium">medium</span>

**Commit**: [80dbc62a76](https://github.com/astral-sh/ruff/commit/80dbc62a7654bfc6165f3f4dff46df10c94abb8a)

<details>
<summary>Task prompt</summary>

> Fix the pylint PLC2701 (import-private-name) rule in two ways: (1) Stop
flagging dunder submodules like `\_\_main\_\_` as private imports by using the
`is\_dunder` helper instead of a simple `starts\_with("\_\_")` check, which
incorrectly matched dunder names. (2) Improve diagnostic ranges to point
at the exact private name segment rather than the entire import binding,
using a tokenizer to locate the private segment in module paths and alias
name ranges for imported members.

</details>

| Approach | Tests Pass | Precision | Recall | F1 | Duration | Cost |
| -------- | :--------: | :-------: | :----: | :-: | :------: | ---: |
| no-bobbin | 100.0% | 100.0% | 83.3% | 90.0% | 9.2m | $0.00 |
| with-bobbin | 100.0% | 100.0% | 77.8% | 86.7% | 6.3m | $1.92 |

<div class="eval-chart">

![ruff-003_f1_boxplot.svg](./charts/ruff-003_f1_boxplot.svg)

</div>

<div class="eval-chart">

![ruff-003_duration.svg](./charts/ruff-003_duration.svg)

</div>

**Ground truth files**: `crates/ruff_linter/resources/test/fixtures/pylint/import_private_name/submodule/__main__.py`, `crates/ruff_linter/src/rules/pylint/rules/import_private_name.rs`, `crates/ruff_linter/src/rules/pylint/snapshots/ruff_linter__rules__pylint__tests__PLC2701_import_private_name__submodule____main__.py.snap`

**Files touched (no-bobbin)**: `crates/ruff_linter/resources/test/fixtures/pylint/import_private_name/submodule/__main__.py`, `crates/ruff_linter/src/rules/pylint/rules/import_private_name.rs`, `crates/ruff_linter/src/rules/pylint/snapshots/ruff_linter__rules__pylint__tests__PLC2701_import_private_name__submodule____main__.py.snap`
**Files touched (with-bobbin)**: `crates/ruff_linter/resources/test/fixtures/pylint/import_private_name/submodule/__main__.py`, `crates/ruff_linter/src/rules/pylint/rules/import_private_name.rs`, `crates/ruff_linter/src/rules/pylint/snapshots/ruff_linter__rules__pylint__tests__PLC2701_import_private_name__submodule____main__.py.snap`

---

## ruff-004 <span class="eval-easy">easy</span>

**Commit**: [ceb876b823](https://github.com/astral-sh/ruff/commit/ceb876b82300bd237d11e3eb77c46fcf3d3afe85)

<details>
<summary>Task prompt</summary>

> Fix inconsistent handling of forward references (stringized annotations)
in the flake8-pyi PYI034 rule for `\_\_new\_\_`, `\_\_enter\_\_`, and `\_\_aenter\_\_`
methods. Previously, return type annotations using forward references like
`def \_\_new\_\_(cls) -> "MyClass"` were not detected, while non-stringized
versions were. Add a new `is\_name\_or\_stringized\_name` helper that uses
`match\_maybe\_stringized\_annotation` to resolve both plain and stringized
annotations, and use it for the return type checks.

</details>

| Approach | Tests Pass | Precision | Recall | F1 | Duration | Cost |
| -------- | :--------: | :-------: | :----: | :-: | :------: | ---: |
| no-bobbin | 100.0% | 46.7% | 66.7% | 54.2% | 3.9m | $0.00 |
| with-bobbin | 100.0% | 63.3% | 83.3% | 70.8% | 4.5m | $1.67 |

<div class="eval-chart">

![ruff-004_f1_boxplot.svg](./charts/ruff-004_f1_boxplot.svg)

</div>

<div class="eval-chart">

![ruff-004_duration.svg](./charts/ruff-004_duration.svg)

</div>

**Ground truth files**: `crates/ruff_linter/resources/test/fixtures/flake8_pyi/PYI034.py`, `crates/ruff_linter/src/rules/flake8_pyi/rules/non_self_return_type.rs`, `crates/ruff_linter/src/rules/flake8_pyi/snapshots/ruff_linter__rules__flake8_pyi__tests__PYI034_PYI034.py.snap`

**Files touched (no-bobbin)**: `crates/ruff_linter/resources/test/fixtures/flake8_pyi/PYI034.py`, `crates/ruff_linter/resources/test/fixtures/flake8_pyi/PYI034.pyi`, `crates/ruff_linter/src/rules/flake8_pyi/rules/non_self_return_type.rs`, `crates/ruff_linter/src/rules/flake8_pyi/snapshots/ruff_linter__rules__flake8_pyi__tests__PYI034_PYI034.py.snap`, `crates/ruff_linter/src/rules/flake8_pyi/snapshots/ruff_linter__rules__flake8_pyi__tests__PYI034_PYI034.pyi.snap`
**Files touched (with-bobbin)**: `crates/ruff_linter/resources/test/fixtures/flake8_pyi/PYI034.py`, `crates/ruff_linter/src/rules/flake8_pyi/rules/non_self_return_type.rs`, `crates/ruff_linter/src/rules/flake8_pyi/snapshots/ruff_linter__rules__flake8_pyi__tests__PYI034_PYI034.py.snap`

---

## ruff-005 <span class="eval-easy">easy</span>

**Commit**: [aa9c9bf01f](https://github.com/astral-sh/ruff/commit/aa9c9bf01fc32260359a1c0e727ed57c90fc642c)

<details>
<summary>Task prompt</summary>

> Suppress diagnostic output when running `ruff format --check --silent`.
The `--silent` flag was not being respected in format check mode, causing
"Would reformat" messages to still appear. Fix by wrapping the
output-writing match block in a `log\_level > LogLevel::Silent` guard so
that no stdout output is produced in silent mode. Add integration tests
for both `--silent` and `--quiet` modes to verify correct output behavior.

</details>

| Approach | Tests Pass | Precision | Recall | F1 | Duration | Cost |
| -------- | :--------: | :-------: | :----: | :-: | :------: | ---: |
| no-bobbin | 100.0% | 100.0% | 100.0% | 100.0% | 3.6m | $0.00 |
| with-bobbin | 100.0% | 100.0% | 100.0% | 100.0% | 2.8m | $0.63 |

<div class="eval-chart">

![ruff-005_f1_boxplot.svg](./charts/ruff-005_f1_boxplot.svg)

</div>

<div class="eval-chart">

![ruff-005_duration.svg](./charts/ruff-005_duration.svg)

</div>

**Ground truth files**: `crates/ruff/src/commands/format.rs`, `crates/ruff/tests/cli/format.rs`

**Files touched (no-bobbin)**: `crates/ruff/src/commands/format.rs`, `crates/ruff/tests/cli/format.rs`
**Files touched (with-bobbin)**: `crates/ruff/src/commands/format.rs`, `crates/ruff/tests/cli/format.rs`

---