Skip to content

Conversation

@Nivesh-01
Copy link
Collaborator

These tests are for testing metadata handling in full ingestion cylce accross a cluster

Nivesh Tuwani added 5 commits September 23, 2025 17:32
I, Nivesh Tuwani <[email protected]>, hereby add my Signed-off-by to this commit: 8efa09f

Signed-off-by: Nivesh Tuwani <[email protected]>

Signed-off-by: Nivesh Tuwani <[email protected]>
Signed-off-by: Nivesh Tuwani <[email protected]>
Copy link
Collaborator

@BCathcart BCathcart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just took a quick peek for now. Let's rebase this on top of the other code once it's merged to clean up the diff.

# Comprehensive test: Create index with multiple field types for both tokenization and metadata validation
comprehensive_index = "comprehensive_test_idx"

# Create index with multiple field types
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"with multiple text fields"

"SCHEMA", "title", "TEXT", "content", "TEXT", "score", "NUMERIC"
) == b"OK"

# Insert test data that covers both tokenization and metadata validation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the data relevant to metadata validation in any way?


# Validate index is removed from list
import time
time.sleep(0.5) # Brief wait for cleanup
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should wait for a condition rather than sleep

"Index with name 'index123' not found",
)

def test_error_handling_metadata_validation(self):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Didn't we talk about removing this?

@allenss-amazon allenss-amazon added the FT Pertains to the Full-Text project label Nov 2, 2025
@BCathcart
Copy link
Collaborator

Did we merge a PR that already covered some of this? IIRC this was to spit off an end-to-end test. Everything in the test I think is covered by other tests and the end-to-end functionality should be stressed in our upcoming endurance test so I'd suggest we close this as you have more important things to focus on right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

FT Pertains to the Full-Text project

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants