how to avoid bibtex error message “repeated entry” for an entry appearing in several bibtex files?

Question

I am using several bibtex files, dedicated to several topics. But some references are common to several topics and then appear in several of my bibtex files. Currently, I am writing a document dealing with several of these topics, and need to use several of these bibtex files at the same time. Obviously, I get the error message when compiling with bibtex: "repeated entry". I would like to avoid this error message, but without removing my entries from the bibtex files, as I need them when compiling only with one of them (when writing articles on one topic only), and without merging my bibtex files.

Answer 1

The easiest solution is to have one BiBTeX file only.

And by that, I really mean one BiBTeX file on your system for your whole bibliography.

As far as I understand this is actually the intended usage, and there are several good softwares out there that make managing a bibliography easy. Much easier, in fact, than having to manage separate bibliographies. This is also why BiBTeX only includes those references that are actually used, and not just the whole file.

Answer 2

If you don't mind a bit of command-line, why not create a bib file just for this paper using just the references you need, using bibtool:

bibtool -s -d -x paper.aux A.bib B.bib C.bib > paper.bib

Answer 3

Answer

I recommend using Norman Ramsey's nbibtex for this. The basic idea is that you run the nbibtex command instead of Bibtex, which uses the argument to \cite as a search query, and goes looking for the best match for that query and puts it in the .bbl file it creates.

Another possibility

Something I do with my clients is replace the \bibliography command with the contents of the *.bbl file. Then, magically, you don't need to run Bibtex on that Latex document ever again. The downside of doing this is that if you find errors in your reference list, or if you add items, that magic won't propagate changes back to your *.bib files.

Breaking up bibliography files into a number of separate *.bib files is A Good Thing, IMO, since it allows you to work with other people on putting together good bibliography files: no one except you will want to work with the contents of AllMyReferences.bib file.

Old, lost code

I wrote some code back in my days as a doctoral student that did the following:

1. Looked through the *.aux file for Bibtex keys, where I generally followed the convention author:key in citations;
2. Searched BIBPATH for *.bib files that might match these keys, using the convention to narrow the search where it was used;
3. Looked in those files either for exact matches for those keys, and also in special alternate-key fields in Bibtex entries, to allow one key to be used
4. Report problems where there are (i) keys not matching sources, (ii) several sources for some key (you need to check for errors, ideally this code would have been able to tell whether two citations are identical, but it didn't do that), (iii) one source referenced by several keys (each document should be consistent in the way it cites sources)
5. Create a .bib file from what is found, ensuring that each citation matches exactly one reflist entry, which might mean several occurrences of a single source if it is cited by more than one key, and a .aux key, which cites one key for each source.
6. Run Bibtex on the .aux/.bib file to create the .bbl file to be used by the \thebibliography program.

I don't think this approach makes much sense now given the availability of nbibtex, which is more usable and more robust, but the code did do more in the way of sanity checks of the Bibtex database, which nbibtex doesn't do with the --permissive option, and nbibtex isn't really useful for multiple bibliographies without it.

Answer 4

I think, you are looking for the package bibtopic. But afaik it's not up to date (2006). I would also recommend to create one BiBTeX file. If you want your bibliography sorted by subject, you could use the multibib-package.

Answer 5

There seems to be two ways that one can achieve the desired result

• Comment the repeated bibentry in various bib files, but keep uncommented entry only once. When you want to process them individually, uncomment it to get it listed.
• Make the bibkeys unique (Best method). Use different bibkeys for the same reference item in different parts of the main document. Say one has the key refkey in chapters/parts 1, 3, and 5. Then rename the key to refkey1, refkey2, refkey5 in the bib files of the respective part and accordingly update the \cite commands in the text of the respective part. This is just a Search and Replace task.

Adding an answer, after 2 years, as no one has suggested a solution without removing entries from the bibtex files or without merging bibtex files as the OP wanted. It is independent of the OS or LaTeX distribution that one uses.

Answer 6

Solving this problem is relatively easy on linux. Create a file in your ~/bin/ directory called bibtex that contains the following:

/usr/bin/bibtex $* | sed -r -e "/Repeated entry/,/I'm skipping/ d"

Do $chmod 755 ~/bin/bibtex to make it executable.

This will then replace the raw bibtex command by filtering its output through sed, which is told to delete the Repeated entry message (which extends from the line beginning "Repeated entry" to the line beginning "I'm skipping").

Answer 7

You can use bibtool to merge yours .bib files.

bibtool can retain the original keys while changing the identical keys. Thus if two entries are really the same, you can use the original key. But, if two different entries use the same key, you can use the original key (ex: mykey) for the first entry and the modified key (ex: mykey*b) for the second entry.

Here is an example:

bibtool -f '%s($key)' -Ac -s -v biblio-1.bib biblio-2.bib -o merged-biblio.bib

The merged file (merged-biblio.bib):

@InProceedings{      examplekey1,
  title     = {{A title}},
  author    = {Doe, J.},
  booktitle = {A book title},
  year      = {2012}
}

@InProceedings{   examplekey1*b,
  title     = {{A title}},
  author    = {Doe, J.},
  booktitle = {A book title},
  year      = {2012}
}

@InProceedings{   examplekey2,
  title     = {{A title (first version)}},
  author    = {Foobar, K.},
  booktitle = {Another book title},
  year      = {2013}
}

@InProceedings{   examplekey2*b,
  title     = {{A title (second version)}},
  author    = {Foobar, K.},
  booktitle = {Another book title},
  year      = {2018}
}

The biblio-1.bib file:

@inproceedings{examplekey1,
  title = {{A title}},
  author = {Doe, J.},
  booktitle = {A book title},
  year = {2012}
}

@inproceedings{examplekey2,
  title = {{A title (first version)}},
  author = {Foobar, K.},
  booktitle = {Another book title},
  year = {2013}
}

The bibio-2.bib file:

@inproceedings{examplekey1,
  title = {{A title}},
  author = {Doe, J.},
  booktitle = {A book title},
  year = {2012}
}

@inproceedings{examplekey2,
  title = {{A title (second version)}},
  author = {Foobar, K.},
  booktitle = {Another book title},
  year = {2018}
}