What's the recommended way to make multiple requests to the same URL using different query parameters?

[nbro10]

I need to make multiple requests to a URL, one for each day, which is passed as a query parameter like d=YYYYMMDD. The user provides the start and end date.

My understanding is that this can be done using an incremental sync, where we specify, as cursor field, the field in the response that contains the date.

Is this is the correct approach to do this? What if the response doesn't have any date? What if it has a date but we cannot order or something?

The second problem is that I don't know exactly how to merge data from different parts of the response.

{
"field1": "whatever",
"field2": "whatever2",
"results": [
    {...}, {...}, ...
]
}

The data I need to return is results, but I also need to add field1 and field2 to each object in the results array.

The approach I was trying to use is to create a child substream, which has a record selector for results, while the parent doesn't, then somehow combine the data from the parent and child. However, it's unclear to me how the child and parent substreams interact. I don't know if I will have different combinations. It's not very clear how the incremental sync would work with the child's partition router.

Can someone clarify? Is it possible to do what I need with just one substream? I can't find a way to merge data from one level up into the objects of results. I wouldn't need the 2 substreams if this was possible. Anyway, if that's not possible, is it possible to achieve what I need with the connector build or do I need to create an actual Python connector?