Repository navigation
[Optimizer] Fold Shape -> {Slice, Gather} -> Concat -> Reshape #2736
Description
Activity
Hi, I’m planning to work on this and will submit a PR.
On our side, we handle the
Shape -> {Slice, Gather} -> {AnyOp} -> Concat -> Reshapepattern using the following passes, as long as there is only one dynamic dimension.One thing worth noting is that the
{AnyOp}stage is often present in real-world models, so supporting it can significantly improve the coverage of this optimization.PassManager: `const_folding & shape_inference` `fuse_shape_gather`, `fuse_shape_slice`, `const_folding & shape_inference ` `fuse_concat_reshape`,
In
Shape -> {Slice, Gather} -> Concat -> Reshape, when the dynamic axis coming from Shape is a single axis and the rest of the dimensions are not-1, we can replace the shape for Reshape to have a static-1axis, and eliminate the nodes for dynamic shape evaluation.