* egraph-based midend: draw the rest of the owl. * Rename `egg` submodule of cranelift-codegen to `egraph`. * Apply some feedback from @jsharp during code walkthrough. * Remove recursion from find_best_node by doing a single pass. Rather than recursively computing the lowest-cost node for a given eclass and memoizing the answer at each eclass node, we can do a single forward pass; because every eclass node refers only to earlier nodes, this is sufficient. The behavior may slightly differ from the earlier behavior because we cannot short-circuit costs to zero once a node is elaborated; but in practice this should not matter. * Make elaboration non-recursive. Use an explicit stack instead (with `ElabStackEntry` entries, alongside a result stack). * Make elaboration traversal of the domtree non-recursive/stack-safe. * Work analysis logic in Cranelift-side egraph glue into a general analysis framework in cranelift-egraph. * Apply static recursion limit to rule application. * Fix aarch64 wrt dynamic-vector support -- broken rebase. * Topo-sort cranelift-egraph before cranelift-codegen in publish script, like the comment instructs me to! * Fix multi-result call testcase. * Include `cranelift-egraph` in `PUBLISHED_CRATES`. * Fix atomic_rmw: not really a load. * Remove now-unnecessary PartialOrd/Ord derivations. * Address some code-review comments. * Review feedback. * Review feedback. * No overlap in mid-end rules, because we are defining a multi-constructor. * rustfmt * Review feedback. * Review feedback. * Review feedback. * Review feedback. * Remove redundant `mut`. * Add comment noting what rules can do. * Review feedback. * Clarify comment wording. * Update `has_memory_fence_semantics`. * Apply @jameysharp's improved loop-level computation. Co-authored-by: Jamey Sharp <jamey@minilop.net> * Fix suggestion commit. * Fix off-by-one in new loop-nest analysis. * Review feedback. * Review feedback. * Review feedback. * Use `Default`, not `std::default::Default`, as per @fitzgen Co-authored-by: Nick Fitzgerald <fitzgen@gmail.com> * Apply @fitzgen's comment elaboration to a doc-comment. Co-authored-by: Nick Fitzgerald <fitzgen@gmail.com> * Add stat for hitting the rewrite-depth limit. * Some code motion in split prelude to make the diff a little clearer wrt `main`. * Take @jameysharp's suggested `try_into()` usage for blockparam indices. Co-authored-by: Jamey Sharp <jamey@minilop.net> * Take @jameysharp's suggestion to avoid double-match on load op. Co-authored-by: Jamey Sharp <jamey@minilop.net> * Fix suggestion (add import). * Review feedback. * Fix stack_load handling. * Remove redundant can_store case. * Take @jameysharp's suggested improvement to FuncEGraph::build() logic Co-authored-by: Jamey Sharp <jamey@minilop.net> * Tweaks to FuncEGraph::build() on top of suggestion. * Take @jameysharp's suggested clarified condition Co-authored-by: Jamey Sharp <jamey@minilop.net> * Clean up after suggestion (unused variable). * Fix loop analysis. * loop level asserts * Revert constant-space loop analysis -- edge cases were incorrect, so let's go with the simple thing for now. * Take @jameysharp's suggestion re: result_tys Co-authored-by: Jamey Sharp <jamey@minilop.net> * Fix up after suggestion * Take @jameysharp's suggestion to use fold rather than reduce Co-authored-by: Jamey Sharp <jamey@minilop.net> * Fixup after suggestion * Take @jameysharp's suggestion to remove elaborate_eclass_use's return value. * Clarifying comment in terminator insts. Co-authored-by: Jamey Sharp <jamey@minilop.net> Co-authored-by: Nick Fitzgerald <fitzgen@gmail.com>
110 lines
3.4 KiB
Rust
110 lines
3.4 KiB
Rust
//! Representation of Cranelift IR functions.
|
|
|
|
mod atomic_rmw_op;
|
|
mod builder;
|
|
pub mod condcodes;
|
|
pub mod constant;
|
|
pub mod dfg;
|
|
pub mod dynamic_type;
|
|
pub mod entities;
|
|
mod extfunc;
|
|
mod extname;
|
|
pub mod function;
|
|
mod globalvalue;
|
|
mod heap;
|
|
pub mod immediates;
|
|
pub mod instructions;
|
|
pub mod jumptable;
|
|
pub(crate) mod known_symbol;
|
|
pub mod layout;
|
|
pub(crate) mod libcall;
|
|
mod memflags;
|
|
mod progpoint;
|
|
mod sourceloc;
|
|
pub mod stackslot;
|
|
mod table;
|
|
mod trapcode;
|
|
pub mod types;
|
|
|
|
#[cfg(feature = "enable-serde")]
|
|
use serde::{Deserialize, Serialize};
|
|
|
|
pub use crate::ir::atomic_rmw_op::AtomicRmwOp;
|
|
pub use crate::ir::builder::{
|
|
InsertBuilder, InstBuilder, InstBuilderBase, InstInserterBase, ReplaceBuilder,
|
|
};
|
|
pub use crate::ir::constant::{ConstantData, ConstantPool};
|
|
pub use crate::ir::dfg::{DataFlowGraph, ValueDef};
|
|
pub use crate::ir::dynamic_type::{dynamic_to_fixed, DynamicTypeData, DynamicTypes};
|
|
pub use crate::ir::entities::{
|
|
Block, Constant, DynamicStackSlot, DynamicType, FuncRef, GlobalValue, Heap, Immediate, Inst,
|
|
JumpTable, SigRef, StackSlot, Table, UserExternalNameRef, Value,
|
|
};
|
|
pub use crate::ir::extfunc::{
|
|
AbiParam, ArgumentExtension, ArgumentPurpose, ExtFuncData, Signature,
|
|
};
|
|
pub use crate::ir::extname::{ExternalName, UserExternalName, UserFuncName};
|
|
pub use crate::ir::function::{DisplayFunctionAnnotations, Function};
|
|
pub use crate::ir::globalvalue::GlobalValueData;
|
|
pub use crate::ir::heap::{HeapData, HeapStyle};
|
|
pub use crate::ir::instructions::{
|
|
InstructionData, InstructionImms, Opcode, ValueList, ValueListPool, VariableArgs,
|
|
};
|
|
pub use crate::ir::jumptable::JumpTableData;
|
|
pub use crate::ir::known_symbol::KnownSymbol;
|
|
pub use crate::ir::layout::Layout;
|
|
pub use crate::ir::libcall::{get_probestack_funcref, LibCall};
|
|
pub use crate::ir::memflags::{Endianness, MemFlags};
|
|
pub use crate::ir::progpoint::{ExpandedProgramPoint, ProgramOrder, ProgramPoint};
|
|
pub use crate::ir::sourceloc::RelSourceLoc;
|
|
pub use crate::ir::sourceloc::SourceLoc;
|
|
pub use crate::ir::stackslot::{
|
|
DynamicStackSlotData, DynamicStackSlots, StackSlotData, StackSlotKind, StackSlots,
|
|
};
|
|
pub use crate::ir::table::TableData;
|
|
pub use crate::ir::trapcode::TrapCode;
|
|
pub use crate::ir::types::Type;
|
|
pub use crate::value_label::LabelValueLoc;
|
|
|
|
use crate::entity::{entity_impl, PrimaryMap, SecondaryMap};
|
|
|
|
/// Map of jump tables.
|
|
pub type JumpTables = PrimaryMap<JumpTable, JumpTableData>;
|
|
|
|
/// Source locations for instructions.
|
|
pub(crate) type SourceLocs = SecondaryMap<Inst, RelSourceLoc>;
|
|
|
|
/// Marked with a label value.
|
|
#[derive(Copy, Clone, PartialEq, Eq, Hash)]
|
|
#[cfg_attr(feature = "enable-serde", derive(Serialize, Deserialize))]
|
|
pub struct ValueLabel(u32);
|
|
entity_impl!(ValueLabel, "val");
|
|
|
|
/// A label of a Value.
|
|
#[derive(Debug, Clone, PartialEq, Hash)]
|
|
#[cfg_attr(feature = "enable-serde", derive(Serialize, Deserialize))]
|
|
pub struct ValueLabelStart {
|
|
/// Source location when it is in effect
|
|
pub from: RelSourceLoc,
|
|
|
|
/// The label index.
|
|
pub label: ValueLabel,
|
|
}
|
|
|
|
/// Value label assignements: label starts or value aliases.
|
|
#[derive(Debug, Clone, PartialEq, Hash)]
|
|
#[cfg_attr(feature = "enable-serde", derive(Serialize, Deserialize))]
|
|
pub enum ValueLabelAssignments {
|
|
/// Original value labels assigned at transform.
|
|
Starts(alloc::vec::Vec<ValueLabelStart>),
|
|
|
|
/// A value alias to original value.
|
|
Alias {
|
|
/// Source location when it is in effect
|
|
from: RelSourceLoc,
|
|
|
|
/// The label index.
|
|
value: Value,
|
|
},
|
|
}
|