Skip to main content

rucc_opt/
fold.rs

1//! Constant folding: an instruction whose operands are all constants becomes a constant.
2//!
3//! The smallest transformation there is, and the one the rest of the middle end leans on. Every
4//! later pass produces constants where the source had none, and none of them should have to
5//! evaluate the arithmetic itself.
6//!
7//! It is worth having before any of them because the lowering walk produces constant arithmetic
8//! that nothing in the C asked for. The usual arithmetic conversions widen a literal to the type
9//! of the other operand, so `long y; y + 7` lowers to a 32 bit constant, a `sext` of it and an
10//! add, and nothing downstream can see that the operand of the add is a number. On x86-64 that
11//! costs two instructions and a register on every operation between a wide integer and a
12//! literal, which is most address arithmetic and most loop bounds in real code. That is issue
13//! 378.
14//!
15//! The bit counting instructions are here for a related reason. Nothing in the backend selects an
16//! instruction for any of them yet, so each one that survives to the end becomes the twenty odd
17//! instructions of the software expansion in `rucc_codegen::expand`, inlined at the site. A
18//! `__builtin_clzll` on a value the compiler can already see is the worst version of that: the
19//! answer is a number between nought and sixty four and the code that computes it is the largest
20//! thing in the function. Folding it costs one arm here. That is part of issue 310.
21//!
22//! # How it rewrites
23//!
24//! In place. An instruction that folds keeps its result value and becomes an `iconst`, because
25//! the value it produced already has the right type and every use of it is already correct. So
26//! there is no rewriting of uses, no new value, and nothing for a later pass to have to know
27//! about. What is left behind is the old operand, now used by nothing, which costs nothing in
28//! the output because the backend materializes a constant where it is wanted rather than where
29//! the IR wrote it, and which dead code elimination will take out of the printed IR when there
30//! is one.
31//!
32//! # What it does not fold
33//!
34//! Not the divides and the remainders. Both have two cases the language leaves undefined, a zero
35//! divisor and the most negative value divided by minus one, and both want guarding rather than
36//! evaluating. They belong with the strength reduction that turns a division by a constant into
37//! a multiply, which is where somebody looking for division arithmetic will look.
38//!
39//! Not floating point arithmetic. Folding it means deciding what rounding mode to fold under and
40//! what to do about a signalling NaN, and `rucc_base::float` has the arithmetic but the decision
41//! about the environment belongs with the rest of the floating point work rather than in the first
42//! pass.
43//!
44//! Negation is folded, and is inside that boundary rather than an exception to it. 754 says a
45//! negation flips the sign bit and copies every other bit, for every input including a NaN and a
46//! zero, so it is exact, it raises nothing and it never consults the rounding mode: there is no
47//! decision about the environment in it to get wrong. The reason to bother is that C has no
48//! negative floating constant. Every one of them is a unary minus applied to a positive one, so
49//! `-1.0` arrives as an `fneg` of an `fconst`, and without this the back end makes a constant, a
50//! mask and three moves through a general register out of what should be one load. That is every
51//! negative floating literal in every program, and it is issue 1427.
52//!
53//! A bitcast of a constant is folded for the same reason and pays for the same kind of code. It is
54//! the same bits read as another type of the same width, so there is nothing to decide about it
55//! either, and what it unblocks is `fabs` and `copysign` of a constant: neither is a call, the
56//! front end lowers both to a mask over the bits, and without this the mask and the two bitcasts
57//! around it survive to the back end computing a number the compiler already has.
58//!
59//! A conversion from floating point to an integer is folded, and is inside that boundary rather
60//! than an exception to it. C says the conversion discards the fractional part, so the rounding is
61//! the language's rather than the environment's and nothing anybody sets at run time reaches it.
62//! What is left is a value whose truncation does not fit the destination type, and a NaN, and both
63//! of those are undefined rather than a number: `rucc_base::float::Float::to_integer` reports each
64//! as `Status::INVALID` and neither folds, which is the rule below for an add that overflows under
65//! `nsw` applied to the same kind of program. That is issue 1357.
66//!
67//! Not an operation that overflows under `nsw` or `nuw`. The result there is poison, so any
68//! answer would be a valid refinement, and quietly picking the wrapping one hides a program that
69//! has stepped outside the language from the sanitizer that should be reporting it.
70//!
71//! Not floating point comparisons, for the reason above and one more: an ordered predicate and an
72//! unordered one differ only on a NaN, so the answer is the whole of what makes them two
73//! predicates, and evaluating it is the floating point decision rather than a step around it.
74//!
75//! Integer comparisons are folded, and were not until issue 352 was closed. An `icmp` produces an
76//! `i1`, and while nothing lowered one that was left standing on its own, folding one would have
77//! turned working code into code that does not build. There is now a rule for a one bit constant
78//! and one for a byte holding it, so the constant this leaves behind lowers wherever the
79//! comparison did.
80
81use rucc_base::float::{Float, Status};
82use rucc_ir::{Block, Def, Extra, Flags, Func, Imm, Inst, InstData, IntPred, Opcode, Type, Value};
83
84use crate::{Analyses, Analysis, Fuel, Pass, Preserved, Stats};
85
86/// Recorded once for each instruction that became a constant.
87const FOLDED: &str = "instruction with constant operands folded to a constant";
88
89/// Recorded for an instruction that would have folded if there had been fuel for it.
90///
91/// Not a missed optimization in the ordinary sense, since the fuel is a person deliberately
92/// stopping the pass. It is here because it is the number a bisection is searching for: the count
93/// of sites past the cut is how far there is left to go.
94const NO_FUEL: &str = "instruction not folded, the pass ran out of fuel";
95
96/// The pass. It holds nothing, because folding needs to know nothing beyond the instruction.
97#[derive(Debug, Clone, Copy, PartialEq, Eq)]
98pub struct Fold;
99
100impl Pass for Fold {
101    fn name(&self) -> &'static str {
102        "fold"
103    }
104
105    fn describe(&self) -> &'static str {
106        "an instruction whose operands are all constants becomes a constant"
107    }
108
109    fn preserves(&self) -> Preserved {
110        // An instruction becomes a constant where it stands. No block moves, no edge moves,
111        // and a terminator is not one of the instructions this folds, so every analysis in the
112        // cache is about the same graph afterwards as it was before. Not the liveness, though:
113        // the operands the folded instruction read are read by nobody now, and a value whose
114        // last reader went is live over less of the function than it was.
115        Preserved::ALL.without(Analysis::Liveness)
116    }
117
118    fn run(&self, func: &mut Func, _an: &mut Analyses, fuel: &mut Fuel) -> Stats {
119        fold_in(func, fuel)
120    }
121}
122
123/// The whole of the pass, without the analysis cache it does not read.
124///
125/// Apart so that [`crate::ipcp`] can fold a function it has just put a constant into. The
126/// arithmetic a constant parameter enables is what makes that propagation reach a second level, and
127/// running this rather than evaluating it there is what keeps the arithmetic written down once.
128pub(crate) fn fold_in(func: &mut Func, fuel: &mut Fuel) -> Stats {
129    let blocks: Vec<Block> = func.blocks().collect();
130    let mut stats = Stats::new();
131    for block in blocks {
132        let insts: Vec<Inst> = func.insts(block).collect();
133        for inst in insts {
134            let Some(folded) = evaluate(func, inst) else { continue };
135            if !fuel.take() {
136                // Out of fuel, which is a request to stop transforming rather than to stop
137                // looking. Continuing the walk costs nothing and keeps the count of what
138                // could have been folded the same at every fuel setting, which is what makes
139                // a bisection over it monotonic.
140                stats.missed(NO_FUEL);
141                continue;
142            }
143            let ty = func[result_of(func, inst)].ty;
144            let at = func.add_imm(folded);
145            let data = &mut func[inst];
146            // Which constant instruction holds the answer is the result type's question and
147            // not the folded instruction's. An `fneg` and a bitcast out of an integer both
148            // answer in a floating point type and the rest of what folds here answers in an
149            // integer one, and an immediate is the same bits either way.
150            data.opcode = if ty.is_int() { Opcode::IConst } else { Opcode::FConst };
151            data.flags = Flags::NONE;
152            data.args = rucc_ir::ValueList::EMPTY;
153            data.extra = Extra::Imm(at);
154            stats.optimized(FOLDED);
155        }
156    }
157    stats
158}
159
160/// The single result of an instruction that folded.
161fn result_of(func: &Func, inst: Inst) -> Value {
162    func[inst].results().next().expect("an instruction that folds produces a value")
163}
164
165/// What this instruction evaluates to, if it evaluates to anything.
166///
167/// `None` covers every reason not to fold and does not distinguish between them, because the
168/// answer to all of them is the same: leave the instruction alone.
169fn evaluate(func: &Func, inst: Inst) -> Option<Imm> {
170    let data = &func[inst];
171    if data.results != 1 {
172        return None;
173    }
174    let result = data.results().next()?;
175    let ty = func[result].ty;
176    // A vector constant is a `splat` rather than an `iconst` or an `fconst`, so a vector fold
177    // would have to build a different instruction and would have to be right about the lane
178    // count as well.
179    if !ty.is_scalar() {
180        return None;
181    }
182    let args = &func[data.args];
183    // The two that are the bits and nothing else, and the only two here whose answer can have a
184    // floating point type. They are above the gate below rather than inside the match under it
185    // because that gate is what keeps the rest of this file about integers.
186    match data.opcode {
187        Opcode::FNeg => return negated(func, *args.first()?, ty),
188        Opcode::Bitcast => return reinterpreted(func, *args.first()?, ty),
189        _ => {}
190    }
191    if !ty.is_int() {
192        return None;
193    }
194    match data.opcode {
195        Opcode::FPToSI | Opcode::FPToUI => {
196            let value = floating(func, *args.first()?)?;
197            to_integer(value, ty, data.opcode == Opcode::FPToSI)
198        }
199        _ => arithmetic(data, args, ty, &|value| constant(func, value)),
200    }
201}
202
203/// What an instruction of integer arithmetic works out to, given a way to read each operand as a
204/// constant.
205///
206/// The way to read an operand is the caller's, because this pass wants an operand that is already
207/// a constant and nothing more, while [`evaluated`] wants to go on looking underneath one that is
208/// not. Both of them want the arithmetic itself to be this one, so that the two cannot disagree
209/// about what an instruction answers.
210fn arithmetic(
211    data: &InstData,
212    args: &[Value],
213    ty: Type,
214    operand: &dyn Fn(Value) -> Option<(Imm, Type)>,
215) -> Option<Imm> {
216    match data.opcode {
217        Opcode::Trunc | Opcode::SExt | Opcode::ZExt => {
218            let (value, from) = operand(*args.first()?)?;
219            Some(convert(data.opcode, value, from, ty))
220        }
221        Opcode::Shl | Opcode::LShr | Opcode::AShr => {
222            let (value, from) = operand(*args.first()?)?;
223            let (count, count_ty) = operand(*args.get(1)?)?;
224            shift(data.opcode, value, from, count, count_ty, ty, data.flags)
225        }
226        Opcode::Add | Opcode::Sub | Opcode::Mul | Opcode::And | Opcode::Or | Opcode::Xor => {
227            let (lhs, lhs_ty) = operand(*args.first()?)?;
228            let (rhs, _) = operand(*args.get(1)?)?;
229            binary(data.opcode, lhs, rhs, lhs_ty, ty, data.flags)
230        }
231        Opcode::Ctlz | Opcode::Cttz | Opcode::Ctpop | Opcode::Bswap | Opcode::Bitreverse => {
232            let (value, from) = operand(*args.first()?)?;
233            count(data.opcode, value, from, ty)
234        }
235        Opcode::ICmp => {
236            let Extra::IntPred(pred) = data.extra else { return None };
237            let (lhs, from) = operand(*args.first()?)?;
238            let (rhs, _) = operand(*args.get(1)?)?;
239            Some(Imm::int(i128::from(compare(pred, lhs, rhs, from)), ty))
240        }
241        _ => None,
242    }
243}
244
245/// The constant this value works out to, looking through as many as `depth` instructions of
246/// integer arithmetic over constants.
247///
248/// For a pass that runs before this one has had the chance to write the answer down as a constant,
249/// which is [`crate::libcall`]: it runs over the module before any function pass has started, so
250/// an index the source wrote as `x & 3` with `x` known is still an `and` of two constants when it
251/// looks. Nothing here changes the function, and the arithmetic is [`arithmetic`], so the answer
252/// is the one this pass would have written later.
253pub(crate) fn evaluated(func: &Func, value: Value, depth: u32) -> Option<(Imm, Type)> {
254    if let Some(found) = constant(func, value) {
255        return Some(found);
256    }
257    let next = depth.checked_sub(1)?;
258    let Def::Result { inst, .. } = func[value].def else { return None };
259    let data = &func[inst];
260    let ty = func[value].ty;
261    if data.results != 1 || !ty.is_int() || !ty.is_scalar() {
262        return None;
263    }
264    let found = arithmetic(data, &func[data.args], ty, &|arg| evaluated(func, arg, next))?;
265    Some((found, ty))
266}
267
268/// The bits a value holds, if it is a constant of either kind.
269///
270/// Both kinds, because the two rewrites above this are about the bits and do not care which of
271/// them they were written as. A constant of either is one instruction with one immediate, and an
272/// immediate is the bits.
273fn bits_of(func: &Func, value: Value) -> Option<u128> {
274    let Def::Result { inst, .. } = func[value].def else { return None };
275    let data = &func[inst];
276    if !matches!(data.opcode, Opcode::IConst | Opcode::FConst) {
277        return None;
278    }
279    let Extra::Imm(at) = data.extra else { return None };
280    Some(func[at].bits())
281}
282
283/// A negation of a floating point constant, which is that constant with its sign bit flipped.
284///
285/// This is the one piece of floating point arithmetic that folds, and it is inside the boundary
286/// the file header draws rather than an exception to it. Negation is not arithmetic in the sense
287/// that boundary is about: 754 says it flips the sign bit and copies every other bit, for every
288/// input including a NaN and a zero, so it is exact, it raises nothing and it never consults the
289/// rounding mode. There is no decision about the environment to get wrong.
290///
291/// The reason to bother is that C has no negative floating constant. Every one of them is a unary
292/// minus applied to a positive one, so `-1.0` arrives here as an `fneg` of an `fconst` and stays
293/// that way, and what the back end makes of it is a constant, a mask and three moves through a
294/// general register where one load would do. That is every negative floating literal in every
295/// program, and it is issue 1427.
296///
297/// The sign bit is the top bit of the value and not of the object it is stored in. An `f80` is
298/// eighty bits of value in a hundred and twenty eight of storage, and [`Type::bits`] answers
299/// eighty for it, which is the bit this has to flip.
300fn negated(func: &Func, operand: Value, ty: Type) -> Option<Imm> {
301    if !ty.is_float() {
302        return None;
303    }
304    let bits = bits_of(func, operand)?;
305    Some(Imm::from_bits(bits ^ 1u128 << (ty.bits() - 1)))
306}
307
308/// A bitcast of a constant, which is the same bits read as another type of the same width.
309///
310/// It folds in both directions, and the one that pays is out of an integer, because that is what
311/// `fabs` and `copysign` leave behind. Neither is a call: the front end lowers both to a mask over
312/// the bits, so `fabs (1.0)` is a bitcast of an `and` of a bitcast, and without this the three
313/// survive to the back end and compute a number the compiler already has.
314///
315/// The widths are checked rather than assumed. The verifier requires them to match and a fold that
316/// quietly widened or narrowed a constant would be a wrong answer rather than a refused one, which
317/// is not a thing to leave to another pass being right.
318fn reinterpreted(func: &Func, operand: Value, ty: Type) -> Option<Imm> {
319    let from = func[operand].ty;
320    if !from.is_scalar() || from.bits() != ty.bits() {
321        return None;
322    }
323    let bits = bits_of(func, operand)?;
324    Some(Imm::from_bits(bits))
325}
326
327/// The constant this value is, with the type it has, if it is one.
328///
329/// Shared with [`crate::simplify_cfg`], which asks the same question about the condition of a
330/// branch. Asking it in two places would be two answers about what a constant is.
331pub(crate) fn constant(func: &Func, value: Value) -> Option<(Imm, Type)> {
332    let Def::Result { inst, .. } = func[value].def else { return None };
333    if func[inst].opcode != Opcode::IConst {
334        return None;
335    }
336    let Extra::Imm(at) = func[inst].extra else { return None };
337    let ty = func[value].ty;
338    ty.is_int().then(|| (func[at], ty))
339}
340
341/// The floating point constant this value is, read in the format its own type gives it.
342///
343/// An `fconst` stores the bits and the type says how to read them, which is why this is one
344/// function and not a pair of them: the bits of an `f80` and the bits of an `f128` are the same
345/// hundred and twenty eight bits and mean different numbers.
346fn floating(func: &Func, value: Value) -> Option<Float> {
347    let Def::Result { inst, .. } = func[value].def else { return None };
348    if func[inst].opcode != Opcode::FConst {
349        return None;
350    }
351    let Extra::Imm(at) = func[inst].extra else { return None };
352    let format = func[value].ty.format()?.encoding();
353    Some(Float::from_bits(format, func[at].bits()))
354}
355
356/// A conversion of a floating point constant to an integer, and nothing when C does not say what
357/// the answer is.
358///
359/// The two undefined cases are a number whose truncation is outside the destination type and a
360/// NaN, and `to_integer` reports both as [`Status::INVALID`] rather than answering. Folding either
361/// would be picking one refinement of poison and writing it into the program, which is what this
362/// pass declines to do for an add that overflows under `nsw` and declines to do here for the same
363/// reason.
364fn to_integer(value: Float, to: Type, signed: bool) -> Option<Imm> {
365    let (number, status) = value.to_integer(to.bits(), signed);
366    (!status.has(Status::INVALID)).then(|| Imm::int(number, to))
367}
368
369/// A widening or a narrowing of a constant.
370fn convert(opcode: Opcode, value: Imm, from: Type, to: Type) -> Imm {
371    match opcode {
372        // Truncation is the masking that `Imm::int` does anyway, and sign extension is reading
373        // the value as signed at its own width and storing it at the wider one.
374        Opcode::Trunc | Opcode::SExt => Imm::int(value.signed(from), to),
375        // Zero extension reads the same bits as unsigned, which for a width below 128 is a
376        // non-negative number and survives the cast to the signed type `Imm::int` takes.
377        _ => Imm::int(value.unsigned() as i128, to),
378    }
379}
380
381/// A shift of a constant by a constant.
382///
383/// `None` when the count is not one the language defines, which is a count at or above the width
384/// of the value. The result there is poison and folding it would be picking an answer for a
385/// program that asked for none.
386fn shift(
387    opcode: Opcode,
388    value: Imm,
389    from: Type,
390    count: Imm,
391    count_ty: Type,
392    to: Type,
393    flags: Flags,
394) -> Option<Imm> {
395    let by = count.unsigned();
396    if by >= u128::from(to.bits()) || count.signed(count_ty) < 0 {
397        return None;
398    }
399    let by = by as u32;
400    let exact = match opcode {
401        Opcode::Shl => value.signed(from).checked_shl(by)?,
402        // A logical shift right is on the bits rather than on the number, so it reads unsigned
403        // and the cast back cannot lose anything: the value has at most `from.bits()` bits set
404        // and shifting right sets none.
405        Opcode::LShr => (value.unsigned() >> by) as i128,
406        _ => value.signed(from) >> by,
407    };
408    if opcode == Opcode::Shl && overflowed(exact, to, flags) {
409        return None;
410    }
411    Some(Imm::int(exact, to))
412}
413
414/// An arithmetic or bitwise operation on two constants.
415fn binary(opcode: Opcode, lhs: Imm, rhs: Imm, from: Type, to: Type, flags: Flags) -> Option<Imm> {
416    let (a, b) = (lhs.signed(from), rhs.signed(from));
417    let exact = match opcode {
418        // The bitwise three cannot overflow and are the same operation whichever way the
419        // operands are read, so they take the signed reading and are done.
420        Opcode::And => a & b,
421        Opcode::Or => a | b,
422        Opcode::Xor => a ^ b,
423        // The arithmetic three are computed at 128 bits and then asked whether they fit. A type
424        // of 128 bits is the one case where the checked form is doing real work rather than
425        // being a formality, and it is why these are checked rather than wrapping.
426        Opcode::Add => a.checked_add(b)?,
427        Opcode::Sub => a.checked_sub(b)?,
428        _ => a.checked_mul(b)?,
429    };
430    if overflowed(exact, to, flags) {
431        return None;
432    }
433    Some(Imm::int(exact, to))
434}
435
436/// What a comparison of two constants comes out as.
437///
438/// Shared with [`crate::simplify_cfg`], which asks the same question about the condition of a
439/// branch it is deciding the direction of. Two answers about what `slt` means would be one too
440/// many, and the two places would not be checked against each other by anything.
441///
442/// The type is the one the operands have rather than the `i1` the answer has, since that is the
443/// width the comparison is at and the only thing the reading depends on. The two equalities are
444/// the same question whichever way the bits are read, so they compare the immediates directly:
445/// an immediate holds its value in exactly the width of its type, which is what makes that
446/// equality the equality on the numbers.
447pub(crate) fn compare(pred: IntPred, lhs: Imm, rhs: Imm, ty: Type) -> bool {
448    match pred {
449        IntPred::Eq => lhs == rhs,
450        IntPred::Ne => lhs != rhs,
451        IntPred::Slt => lhs.signed(ty) < rhs.signed(ty),
452        IntPred::Sle => lhs.signed(ty) <= rhs.signed(ty),
453        IntPred::Sgt => lhs.signed(ty) > rhs.signed(ty),
454        IntPred::Sge => lhs.signed(ty) >= rhs.signed(ty),
455        IntPred::Ult => lhs.unsigned() < rhs.unsigned(),
456        IntPred::Ule => lhs.unsigned() <= rhs.unsigned(),
457        IntPred::Ugt => lhs.unsigned() > rhs.unsigned(),
458        IntPred::Uge => lhs.unsigned() >= rhs.unsigned(),
459    }
460}
461
462/// One of the five bit operations on a constant.
463///
464/// All five are on the bits rather than on the number, so all five read the value unsigned. An
465/// immediate is stored with everything above its own width cleared, so the bits of a value of a
466/// narrow type are already in the low end of a 128 bit word with zeroes above them, and the whole
467/// of the work here is putting the answer back at the width it was asked at.
468///
469/// The two searches answer the width for a zero argument. C leaves `__builtin_clz(0)` and
470/// `__builtin_ctz(0)` undefined so nothing is entitled to that answer, but it is the answer the
471/// software expansion in `rucc_codegen::expand` gives and `__builtin_ffs` is built on top of it, so
472/// folding to anything else here would make the same program answer two different things depending
473/// on whether the argument was visible. That is a worse outcome than either answer on its own.
474///
475/// A byte swap of a width that is not a whole number of bytes is left alone, which is what the
476/// expansion does with one too. The verifier does not allow one and quietly reversing something
477/// else would be worse than the instruction surviving to a selector that says it has no rule.
478fn count(opcode: Opcode, value: Imm, from: Type, to: Type) -> Option<Imm> {
479    let width = from.bits();
480    if width == 0 || width > 128 {
481        return None;
482    }
483    // The bits of the word that are above the value's own type, which is how far a whole word
484    // answer has to come back down. Both ends of the range above are ruled out for it: a shift by
485    // the width of the word is not defined and a width of nought has no bits to answer about.
486    let spare = 128 - width;
487    let bits = value.unsigned();
488    let answer = match opcode {
489        Opcode::Ctpop => i128::from(bits.count_ones()),
490        // The zeroes above the type are counted by the word and are not the value's, so they come
491        // off. For a zero value that leaves the width, which is the answer wanted.
492        Opcode::Ctlz => i128::from(bits.leading_zeros() - spare),
493        // Trailing zeroes need no correction because the zeroes above the type are above every
494        // set bit, except for a zero value, where the word answers 128 and the width is wanted.
495        Opcode::Cttz => i128::from(bits.trailing_zeros().min(width)),
496        Opcode::Bswap if width % 8 == 0 => (bits.swap_bytes() >> spare) as i128,
497        Opcode::Bitreverse => (bits.reverse_bits() >> spare) as i128,
498        _ => return None,
499    };
500    Some(Imm::int(answer, to))
501}
502
503/// Whether storing `exact` at `to` would lose something the flags promised would not happen.
504///
505/// An operation with neither flag wraps, and wrapping is defined, so the answer there is no
506/// however far outside the type the exact result is.
507fn overflowed(exact: i128, to: Type, flags: Flags) -> bool {
508    let stored = Imm::int(exact, to);
509    if flags.contains(Flags::NSW) && stored.signed(to) != exact {
510        return true;
511    }
512    flags.contains(Flags::NUW) && (exact < 0 || stored.unsigned() != exact as u128)
513}
514
515#[cfg(test)]
516mod tests {
517    use rucc_base::Interner;
518    use rucc_base::float::Format;
519    use rucc_ir::{
520        Block, Builder, Extra, Flags, Float, Func, IntPred, Module, Opcode, Signature, Type, Value,
521    };
522    use rucc_target::{Arch, Env, Os, TargetInfo, Triple};
523
524    use crate::stats::Kind;
525    use crate::{Fuel, Pass, fold::Fold};
526
527    /// A function with one block, ready to have instructions appended to it.
528    fn blank() -> (Interner, Func, Block) {
529        let mut names = Interner::new();
530        let name = names.intern("f");
531        let mut func = Func::new(name, Signature::new().with_returns(&[Type::int(64)]));
532        let block = func.create_block();
533        (names, func, block)
534    }
535
536    /// Runs the pass over the function with as much fuel as it wants, and says whether it
537    /// rewrote anything.
538    fn fold(func: &mut Func) -> bool {
539        Fold.run(func, &mut crate::machine::fixtures::analyses(), &mut Fuel::unlimited()).changed()
540    }
541
542    /// An `fconst` of the number this text spells, in the format the type gives it.
543    ///
544    /// Through `rucc_base::float` rather than through the host's `f64`, for the reason that module
545    /// exists: the bits a literal means are the target's answer and not the machine running the
546    /// test's.
547    fn number(build: &mut Builder<'_>, text: &str, ty: Type) -> Value {
548        let format = ty.format().expect("a floating point type").encoding();
549        let (value, _) = super::Float::parse(text, format).expect("a number");
550        build.fconst(ty, value.to_bits())
551    }
552
553    /// The constant a value now holds, or `None` if it is not one.
554    fn value_of(func: &Func, value: Value, ty: Type) -> Option<i128> {
555        let rucc_ir::Def::Result { inst, .. } = func[value].def else { return None };
556        if func[inst].opcode != Opcode::IConst {
557            return None;
558        }
559        let Extra::Imm(at) = func[inst].extra else { return None };
560        Some(func[at].signed(ty))
561    }
562
563    /// The bits a value now holds, or `None` if it is not a floating point constant.
564    fn float_bits(func: &Func, value: Value) -> Option<u128> {
565        let rucc_ir::Def::Result { inst, .. } = func[value].def else { return None };
566        if func[inst].opcode != Opcode::FConst {
567            return None;
568        }
569        let Extra::Imm(at) = func[inst].extra else { return None };
570        Some(func[at].bits())
571    }
572
573    /// C has no negative floating constant, so `-1.0` is a unary minus on a positive one and
574    /// arrives here as two instructions. This is the fold that makes it one.
575    #[test]
576    fn a_negated_floating_constant_becomes_a_constant() {
577        let (_, mut func, block) = blank();
578        let ty = Type::float(Float::F64);
579        let mut build = Builder::new(&mut func, block);
580        let one = number(&mut build, "1.0", ty);
581        let minus = build.unary(Opcode::FNeg, one, ty);
582        build.ret(&[minus]);
583        assert!(fold(&mut func));
584        assert_eq!(float_bits(&func, minus), Some(0xbff0_0000_0000_0000));
585    }
586
587    /// Negation is the sign bit and nothing else, which is what lets it fold at all, and a
588    /// negative zero is where that shows: the value is equal to a positive zero and the bits are
589    /// not, so anything that went through a comparison would give the wrong answer here.
590    #[test]
591    fn a_negated_zero_keeps_its_sign_bit() {
592        let (_, mut func, block) = blank();
593        let ty = Type::float(Float::F64);
594        let mut build = Builder::new(&mut func, block);
595        let zero = number(&mut build, "0.0", ty);
596        let minus = build.unary(Opcode::FNeg, zero, ty);
597        build.ret(&[minus]);
598        assert!(fold(&mut func));
599        assert_eq!(float_bits(&func, minus), Some(1 << 63));
600    }
601
602    /// The same for a NaN, whose payload goes through untouched. 754 says negation copies every
603    /// bit but the sign for every input, and a NaN is the input where a compiler that quietly did
604    /// arithmetic instead would be caught.
605    #[test]
606    fn a_negated_nan_keeps_its_payload() {
607        let (_, mut func, block) = blank();
608        let ty = Type::float(Float::F64);
609        let mut build = Builder::new(&mut func, block);
610        let nan = build.fconst(ty, 0x7ff8_0000_dead_beef);
611        let minus = build.unary(Opcode::FNeg, nan, ty);
612        build.ret(&[minus]);
613        assert!(fold(&mut func));
614        assert_eq!(float_bits(&func, minus), Some(0xfff8_0000_dead_beef));
615    }
616
617    /// The sign bit of an `f80` is the top bit of the eighty the value has and not of the hundred
618    /// and twenty eight the object is stored in, which is the one place this could be written
619    /// wrong and give a number nobody asked for.
620    #[test]
621    fn the_sign_bit_of_an_x87_value_is_the_top_bit_of_its_width() {
622        let (_, mut func, block) = blank();
623        let ty = Type::float(Float::F80);
624        let mut build = Builder::new(&mut func, block);
625        let one = number(&mut build, "1.0", ty);
626        let minus = build.unary(Opcode::FNeg, one, ty);
627        build.ret(&[minus]);
628        assert!(fold(&mut func));
629        let bits = float_bits(&func, minus).expect("a constant");
630        assert_eq!(bits >> 79 & 1, 1, "the sign bit is set");
631        assert_eq!(bits >> 80, 0, "nothing above the value is touched");
632    }
633
634    /// A bitcast of a constant is the same bits read as another type, which is what `fabs` of a
635    /// constant needs: the front end lowers it to a mask over the bits rather than to a call, so
636    /// folding it away is three instructions rather than one.
637    #[test]
638    fn a_bitcast_of_a_constant_is_the_same_bits() {
639        let (_, mut func, block) = blank();
640        let ty = Type::float(Float::F64);
641        let bits = Type::int(64);
642        let mut build = Builder::new(&mut func, block);
643        let value = number(&mut build, "-3.5", ty);
644        let number = build.unary(Opcode::Bitcast, value, bits);
645        let mask = build.iconst(bits, i128::from(i64::MAX));
646        let cleared = build.binary(Opcode::And, number, mask, Flags::NONE);
647        let back = build.unary(Opcode::Bitcast, cleared, ty);
648        build.ret(&[back]);
649        assert!(fold(&mut func));
650        assert_eq!(float_bits(&func, back), Some(0x400c_0000_0000_0000));
651    }
652
653    /// A bitcast whose operand is not a constant is left alone, which is the case nearly every
654    /// bitcast in a real function is.
655    #[test]
656    fn a_bitcast_of_something_that_is_not_a_constant_is_left_alone() {
657        let mut names = Interner::new();
658        let name = names.intern("f");
659        let ty = Type::float(Float::F64);
660        let signature = Signature::new().with_params(&[ty]).with_returns(&[Type::int(64)]);
661        let mut func = Func::new(name, signature);
662        let block = func.create_block();
663        let x = func.append_param(block, ty);
664        let mut build = Builder::new(&mut func, block);
665        let number = build.unary(Opcode::Bitcast, x, Type::int(64));
666        build.ret(&[number]);
667        assert!(!fold(&mut func));
668        assert_eq!(value_of(&func, number, Type::int(64)), None);
669    }
670
671    #[test]
672    fn a_widened_constant_becomes_a_constant_of_the_wider_type() {
673        let (_, mut func, block) = blank();
674        let mut build = Builder::new(&mut func, block);
675        let narrow = build.iconst(Type::int(32), 7);
676        let wide = build.unary(Opcode::SExt, narrow, Type::int(64));
677        build.ret(&[wide]);
678        assert!(fold(&mut func));
679        assert_eq!(value_of(&func, wide, Type::int(64)), Some(7));
680    }
681
682    #[test]
683    fn sign_extension_copies_the_sign_and_zero_extension_does_not() {
684        for (opcode, expected) in [(Opcode::SExt, -1_i128), (Opcode::ZExt, 0xffff_ffff)] {
685            let (_, mut func, block) = blank();
686            let mut build = Builder::new(&mut func, block);
687            let narrow = build.iconst(Type::int(32), -1);
688            let wide = build.unary(opcode, narrow, Type::int(64));
689            build.ret(&[wide]);
690            assert!(fold(&mut func));
691            assert_eq!(value_of(&func, wide, Type::int(64)), Some(expected), "{opcode:?}");
692        }
693    }
694
695    #[test]
696    fn truncation_keeps_the_low_bits_and_reads_them_at_the_narrow_width() {
697        let (_, mut func, block) = blank();
698        let mut build = Builder::new(&mut func, block);
699        let wide = build.iconst(Type::int(32), 0x1234_5680);
700        let narrow = build.unary(Opcode::Trunc, wide, Type::int(8));
701        build.ret(&[narrow]);
702        assert!(fold(&mut func));
703        assert_eq!(value_of(&func, narrow, Type::int(8)), Some(-128));
704    }
705
706    #[test]
707    fn the_arithmetic_and_the_bitwise_operations_are_evaluated() {
708        let cases = [
709            (Opcode::Add, 6_i128, 7_i128, 13_i128),
710            (Opcode::Sub, 6, 7, -1),
711            (Opcode::Mul, 6, 7, 42),
712            (Opcode::And, 0b1100, 0b1010, 0b1000),
713            (Opcode::Or, 0b1100, 0b1010, 0b1110),
714            (Opcode::Xor, 0b1100, 0b1010, 0b0110),
715        ];
716        for (opcode, a, b, want) in cases {
717            let (_, mut func, block) = blank();
718            let mut build = Builder::new(&mut func, block);
719            let lhs = build.iconst(Type::int(64), a);
720            let rhs = build.iconst(Type::int(64), b);
721            let out = build.binary(opcode, lhs, rhs, Flags::NONE);
722            build.ret(&[out]);
723            assert!(fold(&mut func), "{opcode:?}");
724            assert_eq!(value_of(&func, out, Type::int(64)), Some(want), "{opcode:?}");
725        }
726    }
727
728    #[test]
729    fn the_three_shifts_are_evaluated_and_the_two_right_ones_differ_on_the_sign() {
730        let cases = [(Opcode::Shl, -8_i128, 1_i128, -16_i128), (Opcode::AShr, -8, 1, -4)];
731        for (opcode, a, b, want) in cases {
732            let (_, mut func, block) = blank();
733            let mut build = Builder::new(&mut func, block);
734            let lhs = build.iconst(Type::int(64), a);
735            let rhs = build.iconst(Type::int(64), b);
736            let out = build.binary(opcode, lhs, rhs, Flags::NONE);
737            build.ret(&[out]);
738            assert!(fold(&mut func), "{opcode:?}");
739            assert_eq!(value_of(&func, out, Type::int(64)), Some(want), "{opcode:?}");
740        }
741        // The logical shift is the one that reads the value as bits, so minus eight shifted
742        // right by one is a very large positive number rather than minus four.
743        let (_, mut func, block) = blank();
744        let mut build = Builder::new(&mut func, block);
745        let lhs = build.iconst(Type::int(64), -8);
746        let rhs = build.iconst(Type::int(64), 1);
747        let out = build.binary(Opcode::LShr, lhs, rhs, Flags::NONE);
748        build.ret(&[out]);
749        assert!(fold(&mut func));
750        assert_eq!(value_of(&func, out, Type::int(64)), Some(i128::from(i64::MAX) - 3));
751    }
752
753    /// The one instruction under test, on one constant, folded as far as the pass takes it.
754    fn one(opcode: Opcode, ty: Type, arg: i128) -> Option<i128> {
755        let (_, mut func, block) = blank();
756        let mut build = Builder::new(&mut func, block);
757        let value = build.iconst(ty, arg);
758        let out = build.unary(opcode, value, ty);
759        build.ret(&[out]);
760        fold(&mut func);
761        value_of(&func, out, ty)
762    }
763
764    #[test]
765    fn the_bit_counts_are_evaluated_at_the_width_they_were_asked_at() {
766        let cases = [
767            (Opcode::Ctlz, 64, 0x0000_1000_0000_0000_i128, 19_i128),
768            (Opcode::Ctlz, 32, 0x0000_1000, 19),
769            (Opcode::Cttz, 64, 0x0000_1000_0000_0000, 44),
770            (Opcode::Cttz, 32, 0x0000_1000, 12),
771            (Opcode::Ctpop, 64, 0x0000_1000_0000_0000, 1),
772            (Opcode::Ctpop, 32, -1, 32),
773            (Opcode::Ctpop, 64, -1, 64),
774        ];
775        for (opcode, width, arg, want) in cases {
776            let ty = Type::int(width);
777            assert_eq!(one(opcode, ty, arg), Some(want), "{opcode:?} at {width} of {arg:#x}");
778        }
779    }
780
781    #[test]
782    fn a_search_for_a_bit_in_a_zero_answers_the_width_the_expansion_answers() {
783        for width in [8_u32, 16, 32, 64] {
784            let ty = Type::int(width);
785            let want = Some(i128::from(width));
786            assert_eq!(one(Opcode::Ctlz, ty, 0), want, "leading, at {width}");
787            assert_eq!(one(Opcode::Cttz, ty, 0), want, "trailing, at {width}");
788            assert_eq!(one(Opcode::Ctpop, ty, 0), Some(0), "count, at {width}");
789        }
790    }
791
792    #[test]
793    fn the_two_reversals_are_evaluated_and_a_byte_swap_of_a_part_of_a_byte_is_not() {
794        let ty = Type::int(32);
795        assert_eq!(one(Opcode::Bswap, ty, 0x1234_5678), Some(0x7856_3412));
796        assert_eq!(one(Opcode::Bswap, Type::int(16), 0x1234), Some(0x3412));
797        assert_eq!(one(Opcode::Bitreverse, Type::int(8), 0b1010_1100), Some(0b0011_0101));
798        // A width that is not a whole number of bytes has no byte swap, so there is nothing to
799        // evaluate and the instruction stays for the backend to refuse.
800        let (_, mut func, block) = blank();
801        let mut build = Builder::new(&mut func, block);
802        let value = build.iconst(Type::int(4), 0b1010);
803        let out = build.unary(Opcode::Bswap, value, Type::int(4));
804        build.ret(&[out]);
805        assert!(!fold(&mut func));
806    }
807
808    #[test]
809    fn a_comparison_of_two_constants_becomes_a_one_or_a_nought() {
810        let cases = [
811            (IntPred::Eq, 7_i128, 7_i128, true),
812            (IntPred::Eq, 7, 8, false),
813            (IntPred::Ne, 7, 8, true),
814            (IntPred::Slt, -1, 1, true),
815            (IntPred::Sle, -1, -1, true),
816            (IntPred::Sgt, -1, 1, false),
817            (IntPred::Sge, 1, -1, true),
818            // The same pair read as bits rather than as numbers, where minus one is the largest
819            // value there is and every unsigned answer is the opposite of the signed one.
820            (IntPred::Ult, -1, 1, false),
821            (IntPred::Ule, -1, 1, false),
822            (IntPred::Ugt, -1, 1, true),
823            (IntPred::Uge, -1, 1, true),
824        ];
825        for (pred, a, b, want) in cases {
826            let (_, mut func, block) = blank();
827            let mut build = Builder::new(&mut func, block);
828            let lhs = build.iconst(Type::int(64), a);
829            let rhs = build.iconst(Type::int(64), b);
830            let out = build.icmp(pred, lhs, rhs);
831            build.ret(&[out]);
832            assert!(fold(&mut func), "{pred:?} {a} {b}");
833            // The answer is one bit, where a set bit read as a signed number is minus one, so
834            // the question is which of the two constants it is rather than what it prints as.
835            let got = value_of(&func, out, Type::I1).expect("the comparison folded");
836            assert_eq!(got != 0, want, "{pred:?} {a} {b}");
837        }
838    }
839
840    #[test]
841    fn a_comparison_at_a_narrow_width_is_read_at_that_width() {
842        // Two hundred and fifty five stored in eight bits is minus one, so it is below one when
843        // the comparison is signed and above it when the comparison is not.
844        let ty = Type::int(8);
845        for (pred, want) in [(IntPred::Slt, true), (IntPred::Ult, false)] {
846            let (_, mut func, block) = blank();
847            let mut build = Builder::new(&mut func, block);
848            let lhs = build.iconst(ty, 255);
849            let rhs = build.iconst(ty, 1);
850            let out = build.icmp(pred, lhs, rhs);
851            build.ret(&[out]);
852            assert!(fold(&mut func), "{pred:?}");
853            let got = value_of(&func, out, Type::I1).expect("the comparison folded");
854            assert_eq!(got != 0, want, "{pred:?}");
855        }
856    }
857
858    #[test]
859    fn a_comparison_with_one_constant_operand_is_left_alone() {
860        let (_, mut func, block) = blank();
861        let ty = Type::int(64);
862        let param = func.append_param(block, ty);
863        let mut build = Builder::new(&mut func, block);
864        let rhs = build.iconst(ty, 3);
865        let out = build.icmp(IntPred::Eq, param, rhs);
866        build.ret(&[out]);
867        assert!(!fold(&mut func));
868    }
869
870    #[test]
871    fn a_bit_count_of_something_that_is_not_a_constant_is_left_alone() {
872        for opcode in [Opcode::Ctlz, Opcode::Cttz, Opcode::Ctpop, Opcode::Bswap] {
873            let (_, mut func, block) = blank();
874            let ty = Type::int(64);
875            let param = func.append_param(block, ty);
876            let mut build = Builder::new(&mut func, block);
877            let out = build.unary(opcode, param, ty);
878            build.ret(&[out]);
879            assert!(!fold(&mut func), "{opcode:?}");
880        }
881    }
882
883    #[test]
884    fn a_shift_by_the_width_or_more_is_left_alone_because_the_language_does_not_define_it() {
885        for count in [64_i128, 65, -1] {
886            let (_, mut func, block) = blank();
887            let mut build = Builder::new(&mut func, block);
888            let lhs = build.iconst(Type::int(64), 1);
889            let rhs = build.iconst(Type::int(64), count);
890            let out = build.binary(Opcode::Shl, lhs, rhs, Flags::NONE);
891            build.ret(&[out]);
892            assert!(!fold(&mut func), "a shift by {count} was folded");
893        }
894    }
895
896    #[test]
897    fn an_operation_that_wraps_folds_and_the_same_one_promising_it_will_not_does_not() {
898        let big = i128::from(i32::MAX);
899        for (flags, folds) in [(Flags::NONE, true), (Flags::NSW, false)] {
900            let (_, mut func, block) = blank();
901            let mut build = Builder::new(&mut func, block);
902            let lhs = build.iconst(Type::int(32), big);
903            let rhs = build.iconst(Type::int(32), 1);
904            let out = build.binary(Opcode::Add, lhs, rhs, flags);
905            build.ret(&[out]);
906            assert_eq!(fold(&mut func), folds, "{flags}");
907            if folds {
908                assert_eq!(value_of(&func, out, Type::int(32)), Some(i128::from(i32::MIN)));
909            }
910        }
911    }
912
913    #[test]
914    fn an_unsigned_promise_is_broken_by_a_negative_result_as_well_as_by_a_large_one() {
915        let (_, mut func, block) = blank();
916        let mut build = Builder::new(&mut func, block);
917        let lhs = build.iconst(Type::int(32), 1);
918        let rhs = build.iconst(Type::int(32), 2);
919        let out = build.binary(Opcode::Sub, lhs, rhs, Flags::NUW);
920        build.ret(&[out]);
921        assert!(!fold(&mut func));
922    }
923
924    #[test]
925    fn an_operation_with_one_constant_operand_is_left_alone() {
926        let (_, mut func, block) = blank();
927        let param = func.append_param(block, Type::int(64));
928        let mut build = Builder::new(&mut func, block);
929        let rhs = build.iconst(Type::int(64), 7);
930        let out = build.binary(Opcode::Add, param, rhs, Flags::NONE);
931        build.ret(&[out]);
932        assert!(!fold(&mut func));
933        assert_eq!(func[out_inst(&func, out)].opcode, Opcode::Add);
934    }
935
936    #[test]
937    fn a_conversion_to_an_integer_truncates_toward_zero() {
938        for (text, expected) in [("2.75", 2_i128), ("-2.75", -2), ("0.5", 0), ("-0.5", 0)] {
939            let (_, mut func, block) = blank();
940            let mut build = Builder::new(&mut func, block);
941            let value = number(&mut build, text, Type::float(Float::F64));
942            let out = build.unary(Opcode::FPToSI, value, Type::int(32));
943            build.ret(&[out]);
944            assert!(fold(&mut func), "{text}");
945            assert_eq!(value_of(&func, out, Type::int(32)), Some(expected), "{text}");
946        }
947    }
948
949    #[test]
950    fn a_negative_number_converts_to_an_unsigned_type_only_when_truncating_lands_on_zero() {
951        for (text, expected) in [("-0.5", Some(0)), ("-1.5", None)] {
952            let (_, mut func, block) = blank();
953            let mut build = Builder::new(&mut func, block);
954            let value = number(&mut build, text, Type::float(Float::F64));
955            let out = build.unary(Opcode::FPToUI, value, Type::int(32));
956            build.ret(&[out]);
957            assert_eq!(fold(&mut func), expected.is_some(), "{text}");
958            assert_eq!(value_of(&func, out, Type::int(32)), expected, "{text}");
959        }
960    }
961
962    #[test]
963    fn a_number_the_destination_type_has_no_room_for_is_left_alone() {
964        let (_, mut func, block) = blank();
965        let mut build = Builder::new(&mut func, block);
966        let value = number(&mut build, "1e30", Type::float(Float::F64));
967        let out = build.unary(Opcode::FPToSI, value, Type::int(32));
968        build.ret(&[out]);
969        assert!(!fold(&mut func));
970        assert_eq!(func[out_inst(&func, out)].opcode, Opcode::FPToSI);
971    }
972
973    #[test]
974    fn a_nan_is_left_alone() {
975        let (_, mut func, block) = blank();
976        let mut build = Builder::new(&mut func, block);
977        let value = build.fconst(Type::float(Float::F64), 0x7ff8_0000_0000_0000);
978        let out = build.unary(Opcode::FPToSI, value, Type::int(32));
979        build.ret(&[out]);
980        assert!(!fold(&mut func));
981    }
982
983    #[test]
984    fn a_constant_is_read_in_the_format_its_own_type_gives_it() {
985        // The same hundred and twenty eight bits, which are an x87 three and an `f128` far too
986        // small to be anything but zero once it has been truncated.
987        let bits = super::Float::parse("3.0", Format::X87Extended).expect("a number").0.to_bits();
988        for (float, expected) in [(Float::F80, 3_i128), (Float::F128, 0)] {
989            let (_, mut func, block) = blank();
990            let mut build = Builder::new(&mut func, block);
991            let value = build.fconst(Type::float(float), bits);
992            let out = build.unary(Opcode::FPToSI, value, Type::int(32));
993            build.ret(&[out]);
994            assert!(fold(&mut func), "{float}");
995            assert_eq!(value_of(&func, out, Type::int(32)), Some(expected), "{float}");
996        }
997    }
998
999    #[test]
1000    fn a_conversion_of_something_that_is_not_a_constant_is_left_alone() {
1001        let (_, mut func, block) = blank();
1002        let param = func.append_param(block, Type::float(Float::F64));
1003        let mut build = Builder::new(&mut func, block);
1004        let out = build.unary(Opcode::FPToSI, param, Type::int(32));
1005        build.ret(&[out]);
1006        assert!(!fold(&mut func));
1007    }
1008
1009    #[test]
1010    fn a_divide_is_not_folded_even_when_both_operands_are_constants() {
1011        for opcode in [Opcode::SDiv, Opcode::UDiv, Opcode::SRem, Opcode::URem] {
1012            let (_, mut func, block) = blank();
1013            let mut build = Builder::new(&mut func, block);
1014            let lhs = build.iconst(Type::int(64), 42);
1015            let rhs = build.iconst(Type::int(64), 7);
1016            let out = build.binary(opcode, lhs, rhs, Flags::NONE);
1017            build.ret(&[out]);
1018            assert!(!fold(&mut func), "{opcode:?}");
1019        }
1020    }
1021
1022    #[test]
1023    fn folding_leaves_the_function_something_the_verifier_accepts() {
1024        let mut names = Interner::new();
1025        let name = names.intern("f");
1026        let mut func = Func::new(name, Signature::new().with_returns(&[Type::int(64)]));
1027        let block = func.create_block();
1028        let mut build = Builder::new(&mut func, block);
1029        let narrow = build.iconst(Type::int(32), 7);
1030        let wide = build.unary(Opcode::SExt, narrow, Type::int(64));
1031        build.ret(&[wide]);
1032        assert!(fold(&mut func));
1033        let target = TargetInfo::new(Triple::new(Arch::X86_64, Os::Linux, Env::Gnu));
1034        let module_name = names.intern("m");
1035        let mut module = Module::new(module_name, &target);
1036        module.add_func(func);
1037        rucc_ir::verify(&module, &names).expect("folding does not break the IR");
1038    }
1039
1040    #[test]
1041    fn fuel_stops_the_transformation_and_not_the_walk() {
1042        let build_two = |func: &mut Func, block: Block| {
1043            let mut build = Builder::new(func, block);
1044            let a = build.iconst(Type::int(32), 7);
1045            let wide_a = build.unary(Opcode::SExt, a, Type::int(64));
1046            let b = build.iconst(Type::int(32), 9);
1047            let wide_b = build.unary(Opcode::SExt, b, Type::int(64));
1048            let sum = build.binary(Opcode::Add, wide_a, wide_b, Flags::NONE);
1049            build.ret(&[sum]);
1050            (wide_a, wide_b)
1051        };
1052
1053        let (_, mut none, block) = blank();
1054        let (first, _) = build_two(&mut none, block);
1055        let stats =
1056            Fold.run(&mut none, &mut crate::machine::fixtures::analyses(), &mut Fuel::of(0));
1057        assert!(!stats.changed());
1058        assert_eq!(none[out_inst(&none, first)].opcode, Opcode::SExt);
1059        // Both of them looked at and neither of them folded, which is the count a bisection is
1060        // reading: how many sites are left past where the fuel ran out.
1061        assert_eq!(stats.count(Kind::Missed, super::NO_FUEL), 2);
1062
1063        let (_, mut one, block) = blank();
1064        let (first, second) = build_two(&mut one, block);
1065        let mut fuel = Fuel::of(1);
1066        let stats = Fold.run(&mut one, &mut crate::machine::fixtures::analyses(), &mut fuel);
1067        assert!(stats.changed());
1068        assert_eq!(fuel.spent(), 1);
1069        assert_eq!(stats.count(Kind::Optimized, super::FOLDED), 1);
1070        assert_eq!(stats.count(Kind::Missed, super::NO_FUEL), 1);
1071        assert_eq!(one[out_inst(&one, first)].opcode, Opcode::IConst);
1072        assert_eq!(one[out_inst(&one, second)].opcode, Opcode::SExt);
1073    }
1074
1075    #[test]
1076    fn folding_one_operation_uncovers_the_next() {
1077        let (_, mut func, block) = blank();
1078        let mut build = Builder::new(&mut func, block);
1079        let a = build.iconst(Type::int(32), 7);
1080        let wide = build.unary(Opcode::SExt, a, Type::int(64));
1081        let b = build.iconst(Type::int(64), 9);
1082        let sum = build.binary(Opcode::Add, wide, b, Flags::NONE);
1083        build.ret(&[sum]);
1084        assert!(fold(&mut func));
1085        // One walk in order is enough for this shape, because a constant is written before it
1086        // is used and the walk is in the same order.
1087        assert_eq!(value_of(&func, sum, Type::int(64)), Some(16));
1088    }
1089
1090    #[test]
1091    fn a_constant_is_left_where_it_is_and_folding_it_again_changes_nothing() {
1092        let (_, mut func, block) = blank();
1093        let mut build = Builder::new(&mut func, block);
1094        let a = build.iconst(Type::int(32), 7);
1095        let wide = build.unary(Opcode::SExt, a, Type::int(64));
1096        build.ret(&[wide]);
1097        assert!(fold(&mut func));
1098        assert!(!fold(&mut func), "a second run found something to do");
1099    }
1100
1101    /// The instruction that defines a value, which every value in these tests has.
1102    fn out_inst(func: &Func, value: Value) -> rucc_ir::Inst {
1103        match func[value].def {
1104            rucc_ir::Def::Result { inst, .. } => inst,
1105            rucc_ir::Def::Param { .. } => panic!("a parameter has no instruction"),
1106        }
1107    }
1108}