1. Chain of Thought

Short CoT $\iff$ Long CoT

Short CoT is characterized by a shallow, linear reasoning process, where conclusions are drawn sequentially, often relying on a limited number of logical nodes. In contrast, Long CoT have these three characteristics.

• Deep Reasoning

  • Requires a sufficient depth of logical processing to manage an extensive set of reasoning nodes.

• Extensive Exploration

  • Involves generating parallel uncertain nodes and transitioning from known to unknown logic.

• Feasible Reflection

  • Involves feedbeck and refinement of logical connections.

References

1. Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models