GNU Makefile: multiple outputs from single rule + preventing intermediate files from being deleted

Question

This is sort of a continuation of question from here. The problem is that there is a rule generating multiple outputs from a single input, and the command is time-consuming so we would prefer to avoid recomputation. Now there is an additional twist, that we want to keep files from being deleted as intermediate files, and rules involve wildcards to allow for parameters.

The solution suggested was that we set up the following rule:

file-a.out: program file.in
    ./program file.in file-a.out file-b.out file-c.out

file-b.out: file-a.out
    @

file-c.out: file-b.out
    @

Then, calling make file-c.out creates both and we avoid issues with running make in parallel with -j switch. All fine so far.

The problem is the following. Because the above solution sets up a chain in the DAG, make considers it differently; the files file-a.out and file-b.out are treated as intermediate files, and they by default get deleted as unnecessary as soon as file-c.out is ready.

A way of avoiding that was mentioned somewhere here, and consists of adding file-a.out and file-b.out as dependencies of a target .SECONDARY, which keeps them from being deleted. Unfortunately, this does not solve my case because my rules use wildcard patters; specifically, my rules look more like this:

file-a-%.out: program file.in
    ./program $* file.in file-a-$*.out file-b-$*.out file-c-$*.out

file-b-%.out: file-a-%.out
    @

file-c-%.out: file-b-%.out
    @

so that one can pass a parameter that gets included in the file name, for example by running

make file-c-12.out

The solution that make documentation suggests is to add these as implicit rules to the list of dependencies of .PRECIOUS, thus keeping these files from being deleted.

The solution with .PRECIOUS works, but it also prevents these files from being deleted when a rule fails and files are incomplete. Is there any other way to make this work?

A hack to solve this is to define a target .SECONDARY with no prerequisites, i.e.,

.SECONDARY:

which informs make that all files should be treated as secondary and thus not removed, unless when make gets interrupted or a rule fails. Unfortunately, this does not allow for selecting a subset of rules with wildcards to work this way, so I consider this only a hack (even though it's useful).

Hmm, there's no stem in the prerequisites there (i.e. you're using file.in rather than file-%.in). It becomes a lot easier if you build file-$a-$n.out from file-$n.in, and it's weird the way it is (make file-c-17.out file-c-18.out) will produce identical outputs with different names unless there is some hidden input source like time. Could the rule be changed to file-a-%.out: program file-%.in ? — p00ya
It's irrelevant to the question at hand. These are just made up rules, the point being that they contain wildcards. The real rules are significantly more complicated but that complexity would hide the problem I am facing. — makesaurus
No, because the fact that file.in does not depend on $* comes from somewhere; there is a reason for that. For example, file.in keeps all the constant parameters while % is used for something I would like to vary. — makesaurus
Instead of a chain, have you tried a secondary join. See this answer: stackoverflow.com/questions/2973445/… — ctrl-alt-delor

slowdog slowdog · Accepted Answer · 2010-06-24T20:14:06

The Simplest Thing

file-a-%.out file-b-%.out file-c-%.out: program file.in
    ./program $* file.in file-a-$*.out file-b-$*.out file-c-$*.out

will do exactly what you want.

(Pattern rules with multiple targets are different than the normal rule with multiple targets that you were asking about here. See the bison example in the make manual.)

GNU Makefile: multiple outputs from single rule + preventing intermediate files from being deleted

2 Answers