## Abstract

This work deals with symbolic mathematical solutions to maximum likelihood on small phylogenetic trees. Maximum likelihood (ML) is increasingly used as an optimality criterion for selecting evolutionary trees, but finding the global optimum is a hard computational task. In this work, we give general analytic solutions for a family of trees with four taxa, two state characters, under a molecular clock. Previously, analytical solutions were known only for three taxa trees. The change from three to four taxa incurs a major increase in the complexity of the underlying algebraic system, and requires novel techniques and approaches. Despite the simplicity of our model, solving ML analytically in it is close to the limit of today's tractability. Four taxa rooted trees have two topologies - the fork (two subtrees with two leaves each) and the comb (one subtree with three leaves, the other with a single leaf). Combining the properties of molecular clock fork trees with the Hadamard conjugation, and employing the symbolic algebra software Maple, we derive a number of topology dependent identities. Using these identities, we substantially simplify the system of polynomial equations for the fork. We finally employ the symbolic algebra software to obtain closed form analytic solutions (expressed parametrically in the input data).

Original language | English |
---|---|

Pages (from-to) | 347-358 |

Number of pages | 12 |

Journal | Mathematical Biosciences |

Volume | 208 |

Issue number | 2 |

DOIs | |

State | Published - Aug 2007 |

Externally published | Yes |

### Bibliographical note

Funding Information:Research supported by ISF grant 418/00. Part of these results were presented at the RECOMB 2003 conference in Berlin.

## Keywords

- Analytic solutions
- Hadamard conjugation
- Maximum likelihood
- Molecular clock
- Phylogenetic trees
- Symbolic manipulation

## ASJC Scopus subject areas

- Statistics and Probability
- Modeling and Simulation
- General Biochemistry, Genetics and Molecular Biology
- General Immunology and Microbiology
- General Agricultural and Biological Sciences
- Applied Mathematics