ETHZ/Simulation
From 2007.igem.org
(→Sensitivity Analysis) |
|||
(32 intermediate revisions not shown) | |||
Line 1: | Line 1: | ||
- | + | [[Image:ETHZ_banner.png|830px]] | |
- | + | <!-- | |
<center>[[ETHZ | Main Page]] [[ETHZ/Model | System Modeling]] [[ETHZ/Simulation | Simulations]] [[ETHZ/Biology | System Implementation]] [[ETHZ/Biology/Lab| Lab Notes]] [[ETHZ/Meet_the_team | Meet the Team]] [[ETHZ/Internal | Team Notes]] [[ETHZ/Pictures | Pictures!]]</center><br> | <center>[[ETHZ | Main Page]] [[ETHZ/Model | System Modeling]] [[ETHZ/Simulation | Simulations]] [[ETHZ/Biology | System Implementation]] [[ETHZ/Biology/Lab| Lab Notes]] [[ETHZ/Meet_the_team | Meet the Team]] [[ETHZ/Internal | Team Notes]] [[ETHZ/Pictures | Pictures!]]</center><br> | ||
- | + | --> | |
- | + | ||
- | + | ||
<html> | <html> | ||
- | |||
<script type="text/javascript" src="http://christos.bergeles.net/eth_dropdowntabs.js"> | <script type="text/javascript" src="http://christos.bergeles.net/eth_dropdowntabs.js"> | ||
Line 19: | Line 16: | ||
<!-- CSS for Drop Down Tabs Menu #1 --> | <!-- CSS for Drop Down Tabs Menu #1 --> | ||
<link rel="stylesheet" type="text/css" href="http://christos.bergeles.net/eth_ddcolortabs.css" /> | <link rel="stylesheet" type="text/css" href="http://christos.bergeles.net/eth_ddcolortabs.css" /> | ||
- | |||
- | |||
- | |||
<div id="colortab" class="ddcolortabs"> | <div id="colortab" class="ddcolortabs"> | ||
<ul> | <ul> | ||
Line 32: | Line 26: | ||
</ul> | </ul> | ||
</div> | </div> | ||
- | |||
<div class="ddcolortabsline"> </div> | <div class="ddcolortabsline"> </div> | ||
Line 38: | Line 31: | ||
<!--1st drop down menu --> | <!--1st drop down menu --> | ||
<div id="dropmenu_home" class="dropmenudiv_a"> | <div id="dropmenu_home" class="dropmenudiv_a"> | ||
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Introduction">Introduction | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Introduction">Introduction</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Team_Members">Team Members | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Team_Members">Team Members</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Acknowledgments">Acknowledgments | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Acknowledgments">Acknowledgments</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Site_Map">Site map | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ#Site_Map">Site map</a> |
</div> | </div> | ||
Line 47: | Line 40: | ||
<!--2nd drop down menu --> | <!--2nd drop down menu --> | ||
<div id="dropmenu_modeling" class="dropmenudiv_a" style="width: 150px;"> | <div id="dropmenu_modeling" class="dropmenudiv_a" style="width: 150px;"> | ||
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Introduction">Introduction | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Introduction">Introduction</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Model_Overview">Model Overview | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Model_Overview">Model Overview</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Detailed_Model">Detailed Model | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Detailed_Model">Detailed Model</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Final_Model">Final Model | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Final_Model">Final Model</a> |
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Modeling_Basics">Modeling Basics Page</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Modeling_Basics">Modeling Basics Page</a> | ||
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Mathematical_Model">Mathematical Model | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Model#Mathematical_Model">Mathematical Model</a> |
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/FSM">FSM View Page</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/FSM">FSM View Page</a> | ||
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/FlipFlop">Flip-Flop View Page</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/FlipFlop">Flip-Flop View Page</a> | ||
Line 60: | Line 53: | ||
<!--3rd drop down menu --> | <!--3rd drop down menu --> | ||
<div id="dropmenu_simulation" class="dropmenudiv_a" style="width: 150px;"> | <div id="dropmenu_simulation" class="dropmenudiv_a" style="width: 150px;"> | ||
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Introduction">Introduction | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Introduction">Introduction</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Simulation_of_Test_Cases">Test Cases | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Simulation_of_Test_Cases">Test Cases</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Sensitivity_Analysis">Sensitivity Analysis | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Simulation#Sensitivity_Analysis">Sensitivity Analysis</a> |
</div> | </div> | ||
<!--4th drop down menu --> | <!--4th drop down menu --> | ||
<div id="dropmenu_biology" class="dropmenudiv_a" style="width: 150px;"> | <div id="dropmenu_biology" class="dropmenudiv_a" style="width: 150px;"> | ||
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#Introduction">Introduction | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#Introduction">Introduction</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#The_Complete_System">The Complete System | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#The_Complete_System">The Complete System</a> |
- | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#System_Phases">System Phases | + | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#System_Phases">System Phases</a> |
+ | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology#Current_Cloning_Status">Current Cloning Status</a> | ||
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology/parts">System Parts Page</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology/parts">System Parts Page</a> | ||
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology/Lab">Lab Notes Page</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Biology/Lab">Lab Notes Page</a> | ||
Line 78: | Line 72: | ||
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Meet_the_team#The_ETH_Zurich_07_Team">The ETH Zurich 07 Team</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Meet_the_team#The_ETH_Zurich_07_Team">The ETH Zurich 07 Team</a> | ||
<a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Meet_the_team#Team_Description">Team Description</a> | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Meet_the_team#Team_Description">Team Description</a> | ||
+ | <a href="https://2007.igem.org/wiki/index.php?title=ETHZ/Internal">Brainstorming Page</a> | ||
</div> | </div> | ||
Line 86: | Line 81: | ||
</html> | </html> | ||
+ | __NOTOC__ | ||
=Introduction= | =Introduction= | ||
Line 94: | Line 90: | ||
== Simulation of Test Cases == | == Simulation of Test Cases == | ||
- | To test all the possible conditions and transitions in our system, we run timing simulations for all 4 different branches in the flow diagram of our protocol, and we plot the concentrations of the inducers, memory proteins and reporter proteins. During each learning, memorizing and recognizing phase, we wait for the steady state of the system to be reached. The three phases of the system are thus separated sufficiently in time. In all the cases, we | + | To test all the possible conditions and transitions in our system, we run timing simulations for all 4 different branches in the flow diagram of our protocol, and we plot the concentrations of the inducers, memory proteins and reporter proteins. During each learning, memorizing and recognizing phase, we wait for the steady state of the system to be reached. The three phases of the system are thus separated sufficiently in time. In all the cases, we use the following procedure: |
* During the first 1000 minutes of the simulation, we do not add any inducers to the system, and as a result, we check for the baseline production of proteins. | * During the first 1000 minutes of the simulation, we do not add any inducers to the system, and as a result, we check for the baseline production of proteins. | ||
* Between 1000 and 2000 minutes, we add the inducer that should be learned, and we let the system reach steady state. | * Between 1000 and 2000 minutes, we add the inducer that should be learned, and we let the system reach steady state. | ||
Line 102: | Line 98: | ||
The parameters of the system are crucial if one wants to have accurate and realistic simulations. We present the parameters used to simulate our system, in the section [[ETHZ/Parameters | Parameters]]. | The parameters of the system are crucial if one wants to have accurate and realistic simulations. We present the parameters used to simulate our system, in the section [[ETHZ/Parameters | Parameters]]. | ||
- | <p>[[Image: | + | <p>[[Image:ETHZTest1_Stand24.10.png|left|thumb|<b>Fig. 2</b>: Test case 1 - Learn and recognize IPTG. The simulated behavior of the system, when IPTG is presented both during the learning phase, and the recognition phase. In both the learning and recognition phase, the system reports by producing CFP, which matches the desired behavior. |420px]] |
- | [[Image: | + | [[Image:ETHZTest2_Stand24.10.png|thumb|<b>Fig. 3</b>: Test case 2 - Learn IPTG and get tested for aTc. The simulated behavior of the system, when IPTG is presented during the learning phase, and aTc is presented during the recognition phase. The system reports by producing RFP during the recognition phase, which matches the desired behavior. |420px]] |
- | [[Image: | + | [[Image:ETHZTest4_Stand24.10.png|left|thumb|<b>Fig. 4</b>: Test case 3 - Learn aTc and get tested for IPTG. The simulated behavior of the system, when aTc is presented during the learning phase, and IPTG is presented during the recognition phase. The system reports by producing GFP during the recognition phase, which matches the desired behavior. |420px]]</p> |
- | [[Image: | + | [[Image:ETHZTest3_Stand24.10.png|right|thumb|<b>Fig. 5</b>: Test case 4 - Learn and recognize aTc. The simulated behavior of the system, when aTc is presented both during the learning phase and the recognition phase. In both the learning and recognition phase the system reports by producing YFP, which matches the desired behavior. |420px]] |
==Sensitivity Analysis== | ==Sensitivity Analysis== | ||
- | + | Before performing simulations we did an intensive literature review to find the parameters of our system. Due to the uncertainty in parameter retrieval, we would like our system to have reduced sensitivity to the parameters. That way, we can have a guaranteed stable performance, even under non-simulated conditions. | |
- | [[Image:ETHZSensitivity.png|right|thumb|<b>Fig. | + | [[Image:ETHZSensitivity.png|right|thumb|<b>Fig. 6</b>: Sensitivity analysis. We plot the sensitivity for each parameter and each test case that corresponds to the different path ways in Fig. 1. |500px]] |
- | We | + | We define sensitivity as the change of the production of the desired florescence protein - which corresponds to the output of our system - depending on the change of the parameters. As shown in Fig. 1 the desired florescence protein output depends on the concentration of the inducers that we present to our system during learning and recognition phase. Overall we have 4 different combinations leading to the 4 different test cases shown in Fig. 1. E.g. when IPTG is presented to the system both during the learning and recognition phase we expect the production of CFPs. That is why we define the sensitivity for test case 1 as |
- | + | ||
- | [[Image:ETHZSensititivityequation.png|center| | + | [[Image:ETHZSensititivityequation.png|center|300px]] |
<!---<math>Sensitivity = \left | \frac{[ CFP^{105%}_{recognition} ] }{\left [ CFP^{105%}_{baseline}\right ] }- \frac{\left [ CFP^{95%}_{recognition} \right ] }{\left [ CFP^{95%}_{baseline} \right ] }\right |</math>---> | <!---<math>Sensitivity = \left | \frac{[ CFP^{105%}_{recognition} ] }{\left [ CFP^{105%}_{baseline}\right ] }- \frac{\left [ CFP^{95%}_{recognition} \right ] }{\left [ CFP^{95%}_{baseline} \right ] }\right |</math>---> | ||
- | + | where | |
+ | * [CFP<sub>recognition</sub><sup>105%</sup>] describes the concentration of CFP during the recognition phase when the parameter that we test for is increased by 5%, | ||
+ | * [CFP<sub>baseline</sub><sup>105%</sup>] describes the concentration of CFP without any inducers given to the system when the parameter that we test for is increased by 5%, | ||
+ | * [CFP<sub>recognition</sub><sup>95%</sup>] describes the concentration of CFP during the recognition phase when the parameter that we test for is decreased by 5%, and | ||
+ | * [CFP<sub>baseline</sub><sup>95%</sup>] describes the concentration of CFP without any inducers given to the system when the parameter that we test for is decreased by 5%. | ||
+ | |||
+ | All concentrations are gained from timing simulations as shown in Fig. 2 when the concentrations reached steady state. E.g. [CFP<sub>recognition</sub>] corresponds to the value of CFP after 4000 minutes while [CFP<sub>baseline</sub>] is equal to the value for CFP after 1000 minutes. | ||
+ | |||
+ | We define sensitivity by using the ratio of [CFP<sub>recognition</sub>] and [CFP<sub>baseline</sub>] to see by which factor the CFP concentration is increased during the recognition phase. The higher this value is the easier it will be possible to determine the correct readout. | ||
+ | |||
+ | We subtract the two ratios of [CFP<sub>recognition</sub>]/[CFP<sub>baseline</sub>] for increasing and decreasing the parameter under test by 5% to quantify how much is the influence of the parameter on the output. If the output ratio does not change the parameter has no influence and the sensitivity is equal to zero. | ||
- | We quantified the sensitivity for all parameters and all 4 test cases. The results are plotted in Fig. | + | We quantified the sensitivity for all parameters and all 4 test cases. Therefor we look at the concentration of |
+ | * CFP in test case 1. A timing simulation for this case is shown in Fig. 2. | ||
+ | * RFP in test case 2. A timing simulation for this case is shown in Fig. 3. | ||
+ | * GFP in test case 3. A timing simulation for this case is shown in Fig. 4. | ||
+ | * YFP in test case 4. A timing simulation for this case is shown in Fig. 5. | ||
+ | The results are plotted in Fig. 6. Furthermore we make sure that no undesired florescence protein is produced during the recognition phase. | ||
The conclusions that can be derived from our sensitivity analysis are the following: | The conclusions that can be derived from our sensitivity analysis are the following: | ||
- | * Our system is most sensitive to the parameter "a", which describes the base production. This is not a surprising result, since we depend on having a good switch, | + | * Most of the parameters are not sensitive which corresponds to the desired behavior since the system should ideally give a constant output for the same input sequence. |
+ | * Our system is most sensitive to the parameter "a", which describes the base production. This is not a surprising result, since we depend on having a good switch. However, we cannot reliably switch off the production of the memory proteins cI and p22cII. This leads to a small signal to noise ration and in the worst case the memory does not work at all. For a more detailed analysis of the switching behavior please see our [[ETHZ/Biology | biological implementation]] page. | ||
* Other sensitive parameters are those that are directly related to the production and decay of the memory proteins cI and p22cII. This can be explained by the fact that our system prefers symmetry between the parameter sets of cI and p22cII, in order to support good switching behavior where the same concentration of p22cII leads to the same repression of cI and vice versa. We can especially see that those parameters seem to be more sensitive for the test cases 1 and 2, where cI has to be stored inside the memory. The reason for this behavior is due to the missing symmetry between the parameters for cI and p22cII, we currently have a bias inside the system towards the production of p22cII. | * Other sensitive parameters are those that are directly related to the production and decay of the memory proteins cI and p22cII. This can be explained by the fact that our system prefers symmetry between the parameter sets of cI and p22cII, in order to support good switching behavior where the same concentration of p22cII leads to the same repression of cI and vice versa. We can especially see that those parameters seem to be more sensitive for the test cases 1 and 2, where cI has to be stored inside the memory. The reason for this behavior is due to the missing symmetry between the parameters for cI and p22cII, we currently have a bias inside the system towards the production of p22cII. |
Latest revision as of 14:27, 26 October 2007
Introduction
As has been presented in the Modeling page, we have created a model of our system that can be described as a finite state machine. In order to examine the behavior of our system thoroughly, we have to simulate it through all the difference phases that can be reached. We carry out our simulations based on the protocol presented in Fig. 1.
Simulation of Test Cases
To test all the possible conditions and transitions in our system, we run timing simulations for all 4 different branches in the flow diagram of our protocol, and we plot the concentrations of the inducers, memory proteins and reporter proteins. During each learning, memorizing and recognizing phase, we wait for the steady state of the system to be reached. The three phases of the system are thus separated sufficiently in time. In all the cases, we use the following procedure:
- During the first 1000 minutes of the simulation, we do not add any inducers to the system, and as a result, we check for the baseline production of proteins.
- Between 1000 and 2000 minutes, we add the inducer that should be learned, and we let the system reach steady state.
- After 2000 minutes, we add the inducer AHL for memory formation, and run the simulation for an additional 1000 minutes, to reach again steady state.
- Between 3000 and 4000 minutes, we test the final behavior of the system, and check if it reacts in the desired way, by showing the appropriate color.
The parameters of the system are crucial if one wants to have accurate and realistic simulations. We present the parameters used to simulate our system, in the section Parameters.
Sensitivity Analysis
Before performing simulations we did an intensive literature review to find the parameters of our system. Due to the uncertainty in parameter retrieval, we would like our system to have reduced sensitivity to the parameters. That way, we can have a guaranteed stable performance, even under non-simulated conditions.
We define sensitivity as the change of the production of the desired florescence protein - which corresponds to the output of our system - depending on the change of the parameters. As shown in Fig. 1 the desired florescence protein output depends on the concentration of the inducers that we present to our system during learning and recognition phase. Overall we have 4 different combinations leading to the 4 different test cases shown in Fig. 1. E.g. when IPTG is presented to the system both during the learning and recognition phase we expect the production of CFPs. That is why we define the sensitivity for test case 1 as
where
- [CFPrecognition105%] describes the concentration of CFP during the recognition phase when the parameter that we test for is increased by 5%,
- [CFPbaseline105%] describes the concentration of CFP without any inducers given to the system when the parameter that we test for is increased by 5%,
- [CFPrecognition95%] describes the concentration of CFP during the recognition phase when the parameter that we test for is decreased by 5%, and
- [CFPbaseline95%] describes the concentration of CFP without any inducers given to the system when the parameter that we test for is decreased by 5%.
All concentrations are gained from timing simulations as shown in Fig. 2 when the concentrations reached steady state. E.g. [CFPrecognition] corresponds to the value of CFP after 4000 minutes while [CFPbaseline] is equal to the value for CFP after 1000 minutes.
We define sensitivity by using the ratio of [CFPrecognition] and [CFPbaseline] to see by which factor the CFP concentration is increased during the recognition phase. The higher this value is the easier it will be possible to determine the correct readout.
We subtract the two ratios of [CFPrecognition]/[CFPbaseline] for increasing and decreasing the parameter under test by 5% to quantify how much is the influence of the parameter on the output. If the output ratio does not change the parameter has no influence and the sensitivity is equal to zero.
We quantified the sensitivity for all parameters and all 4 test cases. Therefor we look at the concentration of
- CFP in test case 1. A timing simulation for this case is shown in Fig. 2.
- RFP in test case 2. A timing simulation for this case is shown in Fig. 3.
- GFP in test case 3. A timing simulation for this case is shown in Fig. 4.
- YFP in test case 4. A timing simulation for this case is shown in Fig. 5.
The results are plotted in Fig. 6. Furthermore we make sure that no undesired florescence protein is produced during the recognition phase.
The conclusions that can be derived from our sensitivity analysis are the following:
- Most of the parameters are not sensitive which corresponds to the desired behavior since the system should ideally give a constant output for the same input sequence.
- Our system is most sensitive to the parameter "a", which describes the base production. This is not a surprising result, since we depend on having a good switch. However, we cannot reliably switch off the production of the memory proteins cI and p22cII. This leads to a small signal to noise ration and in the worst case the memory does not work at all. For a more detailed analysis of the switching behavior please see our biological implementation page.
- Other sensitive parameters are those that are directly related to the production and decay of the memory proteins cI and p22cII. This can be explained by the fact that our system prefers symmetry between the parameter sets of cI and p22cII, in order to support good switching behavior where the same concentration of p22cII leads to the same repression of cI and vice versa. We can especially see that those parameters seem to be more sensitive for the test cases 1 and 2, where cI has to be stored inside the memory. The reason for this behavior is due to the missing symmetry between the parameters for cI and p22cII, we currently have a bias inside the system towards the production of p22cII.