Skip to content

Add chunking for even better generated git messages #50

Description

@eonist
  1. pre-rinse diff payload
  2. smartly chunk the total payload say 100kb
  3. 4k context window. is about 16kb so 10kb for input equals 10 step for loop
  4. call afm llm model 10 times and get special summary
  5. combine summaries into 1 unified summary

considerations:

  • if diff size is extremely big, we need to have some strategies to smartly processes things. because even the interim partial summaries will be too large for the final output summarization step etc. open for suggestions here etc

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions